AN  ANALYSIS  OF  AIRCRAFT  WEAPON  SYSTEMS  COST  GROWTH  AND 


IMPLEMENTATION  OF  ACQUISITION  REFORM  INITIATIVES  USING  A 
HYBRID  ADJUSTED  COST  GROWTH  MODEL 

THESIS 


Richard  A.  Phillips,  Captain,  USAF 

AFIT/GCA/ENV/04M-08 

DEPARTMENT  OF  THE  AIR  FORCE 
AIR  UNIVERSITY 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 


Wright-Patterson  Air  Force  Base,  Ohio 


APPROVED  FOR  PUBFIC  REFEASE;  DISTRIBUTION  UNLIMITED. 


The  views  expressed  in  this  thesis  are  those  of  the  author  and  do  not  reflect  the  official 
policy  or  position  of  the  United  States  Air  Force,  Department  of  Defense,  or  the  U.  S. 
Government. 


AFIT/GCA/ENV/04M-08 


AN  ANALYSIS  OF  AIRCRAFT  WEAPON  SYSTEMS  COST  GROWTH  AND 
IMPLEMENTATION  OF  ACQUISITION  REFORM  INITIATIVES  USING  A 
HYBRID  ADJUSTED  COST  GROWTH  MODEL 


THESIS 


Presented  to  the  Faeulty 

Department  of  Systems  and  Engineering  Management 
Graduate  School  of  Engineering  and  Management 
Air  Force  Institute  of  Technology 
Air  University 

Air  Education  and  Training  Command 
In  Partial  Fulfillment  of  the  Requirements  for  the 
Degree  of  Master  of  Science  in  Cost  Analysis 


Richard  A.  Phillips,  BS 
Captain,  USAF 

March  2004 


APPROVED  FOR  PUBLIC  RELEASE;  DISTRIBUTION  UNLIMITED. 


AFIT/GCA/ENV/04M-08 


AN  ANALYSIS  OF  AIRCRAFT  WEAPON  SYSTEMS  COST  GROWTH  AND 
IMPLEMENTATION  OF  ACQUISITION  REFORM  INITIATIVES  USING  A 
HYBRID  ADJUSTED  COST  GROWTH  MODEL 


Richard  A.  Phillips,  BS 
Captain,  USAF 


Approved; 

_ //signed// _  28  Jan  04 

Miehael  A.  Greiner,  Major,  USAF  (Chairman)  date 

_ //signed// _  28  Jan  04 

Richard  L.  Coleman,  CPT,  USN  (Ret)  (Member)  date 

_ //signed// _  28  Jan  04 

Daniel  E.  Reynolds,  Professor  (Member)  date 


AFIT/GCA/ENV/04M-08 


Abstract 

This  thesis  examined  eost  growth  in  Department  of  Defense  (DoD)  aireraft 
weapon  systems  from  1991  to  2001  using  Seleeted  Aequisition  Report  (SAR)  data  with  a 
hybrid  adjusted  eost  growth  (ACG)  model.  In  addition,  an  analysis  of  aequisition  reform 
initiatives  during  the  treatment  period  was  eondueted  to  determine  if  reform  efforts 
impaeted  aireraft  weapon  system  eost  growth.  A  “pre-reform”  (1  January  1991  to  31 
Deeember  1996)  period  and  “post  reform”  (1  January  1997  to  31  December  2001)  period 
was  subjectively  developed  to  compare  the  mean  annual  ACG  during  each  period  for 
statistical  differences.  The  hybrid  ACG  model  outlined  in  this  thesis  may  aid  program 
managers  and  other  interested  parties  in  determining  weapon  systems  cost  growth,  and 
the  conclusion  drawn  from  analyzing  current  acquisition  initiatives  may  assist  DoD 
leadership  in  assessing  reform  effectiveness  on  reducing  cost  growth. 

This  research  effort  analyzed  78  SARs  for  13  aircraft  weapon  systems  that 
reported  a  Milestone  11  baseline  during  the  treatment  period.  ACG  calculations  revealed 
that  aircraft  systems  from  1  January  1991  to  31  December  2001  averaged  40  percent  cost 
growth  annually.  The  acquisition  reform  analysis  included  43  SARs  from  1 1  programs 
during  the  pre-reform  period  and  35  SARs  from  7  programs  in  the  post-reform  period.  A 
small  sample  t-test  was  used  to  compare  the  annual  means  of  the  two  periods  and 
revealed  that  at  a  .05  significance  level  no  significant  difference  existed  between  the 
annual  average  ACG  for  the  pre-reform  and  post  reform  periods.  The  thesis 
methodology,  results,  and  suggestions  for  future  research  are  provided. 
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AN  ANALYSIS  OF  AIRCRAFT  WEAPON  SYSTEMS  COST  GROWTH  AND 


IMPLEMENTATION  OF  ACQUISITION  REFORM  INITIATIVES  USING  A 
HYBRID  ADJUSTED  COST  GROWTH  MODEL 


I.  Introduction 


General  Issue 

Cost  growth  in  major  weapon  system  programs,  defined  as  the  difference  between 
estimated  and  actual  costs,  has  been  an  enduring  problem  in  the  Department  of  Defense 
(DoD)  for  the  past  four  decades.  According  to  a  1993  RAND  study,  cost  growth  has 
hovered  around  20  percent  since  the  mid  1960s.  Table  1  identifies  the  average  cost 
growth  factors  between  services  as  of  31  December  1990  and  Table  2  provides  the 
average  cost  growth  factors  by  system  type  as  of  31  December  1990. 


Table  1,  Cost  Growth  Differences  Between  Services  (Drezner,  1993:26) 


Service 

Cost 

Growth 

Factor 

Number  of 
Observations 

Average  Program 
Cost  (billions 
FY90$) 

Average  Age  (years 
past  EMD) 

Total  DE 

1.20 

120 

5.50 

9.40 

Air  Force 

1.20 

41 

6.70 

8.70 

Army 

1.35 

28 

2.70 

10.30 

Navy 

1.16 

51 

6.10 

9.50 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 
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Table  2,  Cost  Growth  by  System  Type  (Drezner,  1993:28) 


Weapon 

Type 

Cost 

Growth 

Factor 

Number  of 
Observations 

Average  Program 
Cost  (billions 
FY90$) 

Average  Age  (years 
past  EMD) 

Aircraft 

1.28 

14 

13.8 

10.50 

Helicopter 

1.13 

5 

8.10 

13.00 

Missile 

1.17 

44 

5.10 

9.50 

Electronic 

1.24 

27 

2.20 

8.50 

Munition 

1.22 

7 

1.70 

7.70 

Vehicle 

1.71 

3 

3.00 

12.00 

Space 

1.16 

3 

2.00 

12.00 

Ship 

1.10 

14 

7.50 

9.10 

Other 

0.99 

3 

3.00 

5.70 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 


Risk  and  uncertainty,  an  inherent  driver  in  weapon  systems  development  cost 
growth,  pose  a  significant  challenge  to  the  cost  estimator.  In  an  attempt  to  minimize  risk 
and  uncertainty,  streamline  the  proeurement  process,  and  deerease  eost  growth,  the  DoD 
has  implemented  numerous  aequisition  reform  initiatives  over  the  past  40  years.  Most 
recently,  the  October  30,  2002  memorandum  from  Underseeretary  of  Defense  Wolfowitz 
eanceled  the  DoD  5000  Defense  Aequisition  Policy  Documents  stating  “I  have 
determined  that  the  current  subject  documents  require  revision  to  ereate  an  aequisition 
policy  environment  that  fosters  efficieney,  flexibility,  creativity,  and  innovation” 
(Wolfowitz,  2002).  Cancellation  of  the  DoD  5000  series  marks  the  latest  attempt  by  the 
DoD  to  minimize  weapon  system  cost  growth  and  minimize  negative  publie  opinion 
about  procurement  cost  overruns. 

Specific  Issue 

Historically,  cost  estimation  has  posed  a  tremendous  ehallenge  to  estimators  and 
program  managers  in  defense  weapon  systems  proeurement.  Unrealistie  or  imprecise 
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weapon  system  eost  estimates  negatively  impaet  the  quality  of  deeisions  coneerning  U.S. 
defense  poliey;  distorting  the  rational  for  resouree  alloeation  deeisions.  An  oeeasional 
unrealistie  estimate  would  not  pose  a  signifieant  problem.  However,  even  despite 
aequisition  reform  initiatives  implemented  in  the  1970s  and  1980s  to  reduee  eosts, 
research  has  shown  that  weapon  system  programs  during  this  period  continued  to 
experience  cost  and  schedule  overruns  regularly  (Searle,  1997:38).  In  the  1990s  and 
early  2000s,  additional  reform  initiatives  were  enacted  by  the  Clinton  and  Bush 
administrations  to  curb  this  trend.  Figure  1  displays  the  timeline  of  current  acquisition 
reform  initiatives.  While  the  last  three  DoD  acquisition  chiefs  have  deemed  the  current 
acquisition  reform  movement  successful  (Holbrook,  2003:2-3),  a  weapon  system  cost 
growth  statistical  analysis  is  needed  to  obtain  an  objective  measure  of  the  successfulness 
during  this  period. 


1991  1992  1993  1994  1995  1996  1997  1998  1999  2000  2001  2002  2003 

Figure  1.  Current  Acquisition  Reform  Initiatives  (1991  to  2003) 


Scope  and  Limitations  of  the  Study 

This  study  focuses  on  measuring  total  aircraft  weapon  systems  cost  growth  from 
DoD  Selected  Acquisition  Reports  (SAR)  by  applying  a  hybrid  adjusted  cost  growth 
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model,  along  with  analyzing  the  impaet  of  reeent  aequisition  reform  initiatives  on  eost 
growth  over  time.  While  past  researeh  has  analyzed  eombined  program  eost  growth  over 
all  weapon  systems,  this  study  attempts  to  identify  cost  growth  from  a  more  micro  level 
of  analysis.  The  SAR  is  one  of  the  few  official  management  reporting  systems  that 
provides  consistent  and  reasonably  reliable  data  on  the  status  of  DoD  acquisition 
programs  (Drezner,  1993:7).  These  reports  are  developed  annually  at  the  program  office 
level  and  are  reviewed  by  the  Performance  Management  Office  in  OUSD(A)  before  they 
are  released  in  conjunction  with  the  President’s  budget.  SARs  summarize  the  latest 
estimates  of  cost,  schedule  and  technical  status,  while  separating  program  cost  variance 
into  seven  categories:  Economic,  Quantity,  Estimating,  Engineering,  Schedule,  Support, 
and  Other  (Drezner,  1993:7). 

Eor  the  purpose  of  this  research,  the  SAR  provides  an  easily  accessible,  universally 
utilized  database  that  offers  sufficient  data  reliability;  however,  it  is  not  without 
limitations.  According  to  the  1993  RAND  report,  the  SAR  may  introduce  unacceptable 
error  in  the  cost  growth  calculation  unless  care  is  taken  to  fully  understand  how  the  data 
was  generated  (Drezner,  1993:9).  RAND  identified  the  following  problem  areas  with  the 
SAR: 

1 .  High  level  of  aggregation 

2.  Changing  baseline  estimate  and  program  restructuring 

3.  Changing  preparation  guidelines  and  thresholds 

4.  Inconsistent  allocation  of  cost  variances 

5.  Emphasis  on  effects,  not  causes 

6.  Incomplete  coverage  of  program  causes 
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7.  Unknown  and  varied  budget  levels  for  program  risk 
Additionally,  seeurity  elassifieations  of  sensitive  programs  may  render  some  eost  data 
unavailable  for  this  researeh.  Chapter  III  will  address  the  preeautions  taken  to  minimize 
the  effeets  of  these  problem  areas  on  eost  growth  ealeulations. 

Research  Objectives 

This  research  has  two  main  objectives.  First,  the  study  quantifies  the  magnitude 
of  aircraft  weapon  systems  cost  growth  from  1991  to  2001  using  a  hybrid  adjusted  cost 
growth  methodology.  Capturing  the  current  cost  growth  trend  will  identify  if  acquisition 
programs  have  improved  cost  overruns  or  if  they  continue  to  accumulate  cost  growth. 

The  results  of  this  research  will  provide  insight  into  the  budgetary  status  of  aircraft 
weapon  systems  and  offer  DoD  officials  a  cost  growth  model  that  can  be  used  to 
determine  how  well  program  management  has  done  in  estimating  and  controlling  costs 
within  its  command. 

Second,  the  study  determines  the  impact  of  acquisition  reform  initiatives  on  aircraft 
weapon  systems  cost  growth  from  1991  to  2001.  It  is  important  to  determine  if  continued 
acquisition  reform  efforts  are  actually  accomplishing  their  objectives,  since  previous 
research  has  found  no  conclusive  evidence  that  acquisition  reform  has  reduced  cost 
growth.  This  statement  is  further  reinforced  in  the  1993  RAND  study  which  states,  “It 
seems  reasonable  to  expect  that  the  myriad  of  initiatives  implemented  over  the  last 
several  decades  intended  to  control  costs  and  improve  cost  estimating  capabilities  would 
have  had  some  positive  effect.  Unfortunately,  we  can  detect  no  such  effect  in  the  data” 
(Drezner  1993:50).  If  a  reduction  in  cost  growth  is  found,  DoD  leadership  may  use  this 
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analysis  to  build  a  model  for  estimating  the  amount  of  time  required  before  reform 
initiatives  impaet  eost  growth.  However,  if  eurrent  reform  initiatives  fail  to  prove 
positive  impaet  on  eost  growth,  then  the  aequisition  eommunity  and  legislators  may  need 
to  rethink  the  eurrent  situation  and  address  the  problem  of  eost  growth  from  another 
angle. 

Summary 

This  study  quantifies  the  magnitude  of  aireraft  weapon  system  eost  growth  by 
developing  and  applying  a  RAND  hybrid  adjusted  eost  growth  model.  Expanding  on  the 
eost  growth  determination,  this  researeh  explores  the  impaet  of  reeent  aequisition  reform 
initiatives  on  eurrent  eost  growth  trends.  Identifieation  of  eurrent  eost  growth  levels  and 
the  impaet  of  aequisition  reform  efforts  will  provide  program  managers  and  government 
offieials  with  insight  into  the  effeetiveness  of  the  aequisition  proeess  and  reeent 
legislation  on  redueing  weapon  system  eost  growth. 

Organization  of  the  Study 

This  ehapter  established  the  motivation  for  analyzing  the  topie  and  the  researeh 
objeetives.  Chapter  II  deseribes  past  and  present  aequisition  reform  efforts  and  highlights 
reeent  eost  growth  studies.  Chapter  III  details  the  methodology  used  to  analyze  the 
quantitative  eost  data  and  Chapter  IV  identifies  the  results  of  the  analysis.  Finally, 
Chapter  V  provides  eonelusions  from  the  study  and  reeommendations  for  further 
researeh. 
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II,  Literature  Review 


Chapter  Overview 

This  chapter  provides  a  deseription  of  aireraft  weapon  systems,  examines  both 
historieal  and  eurrent  aequisition  reform  initiatives,  and  reviews  reeent  eost  growth 
studies. 


Aircraft  Weapon  Systems 

Aireraft  Weapon  Systems  encompasses  all  aircraft  programs  whose  primary 
motivation  is  airframe  produetion  as  reported  in  the  Seleeted  Aequisition  Reports  (SAR). 
The  system  capabilities  comprise  bomber,  attack,  fighter,  cargo,  tanker,  and  trainer 
planes.  Table  3  identifies  the  13  speeifie  aireraft  systems  reviewed  in  this  study  and 
provides  each  program’s  technical  nomenclature  along  with  any  eommon  name  in 
parentheses. 


Table  3  Aircraft  Weapon  Systems 


B-IB  (Laneer) 

F-16  (Fighting  Faleon) 

C130-J  (Hereules) 

F-22  (Raptor) 

C-17  (Globemaster  III) 

FA- 18  F/F  (Super  Hornet) 

KC-135R  (Strata tanker) 

FA- 18  (Hornet) 

AV-B(Harrier) 

T-6A  (JPATS) 

AV-B  (Harrier  Remanufaeture) 

F-14D  (Tomeat) 

T-45-TS  (Goshawk) 

Aireraft  weapon  systems  proeurement  and  researeh  test  and  evaluation  (RDT&E) 
estimates  eombined  total  more  than  $25.50  billion  of  the  2004  Department  of  Defense 
(DoD)  budget  (Department  of  Defense,  Program  Weapon  System  Cost  By  Weapon 
System).  This  is  39  pereent  of  the  total  $136  billion  weapon  system  proeurement  and 


7 


RDT&E  budget,  and  identifying  eost  growth  in  these  programs  during  the  1 1  year  period 
from  1991  to  2001  would  be  of  great  interest  to  DoD  leadership. 

Acquisition  Reform 

The  historieal  overview  starts  with  Seeretary  of  Defense  (SECDEF)  Robert 

MeNamara’s  changes  in  1960  and  concludes  with  the  1989  Defense  Management  Report. 

The  current  reform  overview  begins  with  the  National  Performance  Review  (NPR)  and 

ends  with  a  summary  of  recent  DoD  5000  series  rewrites.  During  the  period  in  review, 

acquisition  reform  has  evolved  with  each  administration’s  reports  and  recommendations. 

The  most  recent  acquisition  reform  framework  is  as  follows: 

Acquisition  reform,  a  theory  pervasive  throughout  the  Department  of  Defense,  is 
an  endeavor  to  make  the  acquisition  process  more  effective,  efficient,  and 
productive.  It  involves  reducing  overhead,  streamlining  requirements,  speeding  up 
processes,  cutting  paperwork  and  other  similar  initiatives  to  reduce  bureaucracy. 
Acquisition  reform  includes  a  move  toward  the  use  of  commercial  practices  as 
well  as  the  use  of  private  enterprise  to  do  more  of  the  functions  traditionally  done 
by  government.  (What  is  Acquisition  Reform,  DSMC,  2001) 

Historical  Acquisition  Reform  Overview  (1960s  to  1990) 

Studies  during  the  past  40  years  by  the  DoD  about  acquisition  reform  have 
outlined  ways  to  simplify  and  improve  the  weapon  system  procurement  processes  to 
make  them  more  efficient  and  effective.  Table  4  lists  some  of  the  defense  acquisition 
reports  and  studies  conducted  from  the  1960s  through  the  1980s.  This  historical  reform 
summary  will  focus  on  those  highlighted,  as  these  are  the  ones  recognized  in  most 
acquisition  reform  studies  as  the  most  meaningful  and  significant  efforts  to  shape  the 
acquisition  process  (Fox  &  Field,  1988:41;  Jones,  1999:404). 
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Table  4,  Significant  Defense  Acquisition  Studies  (Jones,  1996:405) 


Report  by 

Initiated  by 

Issued 

*McNamara  Initiatives 

SECDEF 

1961 

Peck  &  Scherer  (Harvard  Business  School) 

Authors 

1962,  1964 

*Packard  Initiatives 

Deputy  SECDEF 

1969-1970 

Blue  Ribbon  Defense  Panel  (Fitzhugh  Commission) 

President 

1970 

Commission  on  Government  Procurement 

Congress 

1972 

J.  Ronald  Fox  (Harvard  Business  School) 

Author 

1974 

Military  Services  and  Secretary  of  Defense 

DoD 

1974-75 

Defense  Science  Board  Summer  Study 

DoD 

1977 

(Acquisition  Cycle  Task  Force) 

Defense  Resources  Board 

DoD 

1979 

DoD  Resource  Management  Study 

President 

1979 

Jacques  S.  Gansler 

Author 

1980 

Acquisition  Improvement  Task  Force 

DoD 

1981 

(Carlucci  Initiatives) 

Special  Panel  on  Defense  Procurement  Procedures 

House  Armed  Services  Committee 

1982 

Grace  Commission 

President 

1983 

Special  Task  Force  on  Selected  Defense 

Senate  Armed  Services  Committee 

1984 

Procurement  Matters 

Georgetown  Center  for  Strategic  and  International  Studies 

Center 

1985 

Blue  Ribbon  Commission  on  Defense  Management 

President 

1986 

(Packard  Commission) 

Defense  Management  Review 

DoD 

1989 

‘Added  by  the  authors 

McNamara  Initiatives 

Modern  acquisition  reform  efforts  began  in  the  1960s  in  an  attempt  to  fix  the 
procurement  system  when  “Secretary  of  Defense  (SECDEF)  Robert  S.  McNamara  (1961 
to  68)  instituted  many  of  the  first  substantial  acquisition  reforms  through  his  centralized 
decision-making  apparatus  and  the  new  Plaiming,  Programming,  and  Budgeting  System” 
(Jones,  1999:402).  The  system  was  a  systematic  process  for  establishing  requirements 
and  incorporating  them  into  a  five  year  budget.  In  addition,  McNamara  formed  the 
Defense  Supply  Agency  (DSA),  Defense  Contract  Administration  Service  (DCAS),  and 
Defense  Contract  Audit  Agency  (DCAA);  all  designed  to  improve  the  government 
acquisition  process.  McNamara  also  initiated  industry  practices  previously  used  at  Ford 
Motor  Company  during  in  his  days  as  an  executive,  there  by  “establishing  requirements 
for  analytical  rigor  in  evaluating  the  need,  costs,  and  operational  effectiveness  of  new 
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weapons  systems”  (Reeves,  1996:16).  His  blueprint  for  evaluating  weapon  system 
programs  through  eoneept  exploration,  researeh  and  development,  and  produetion  phases 
laid  the  framework  for  the  life  eyele  proeess  used  by  the  DoD  and  defense  eontractors 
today.  Despite  these  signifieant  attempts  to  improve  the  weapon  systems  proeurement 
proeess,  DoD  “continued  to  reward  cost  increases  and  to  penalize  cost  reductions”  (Fox 
and  Field,  1988:42),  prompting  future  Defense  Secretaries  and  Congress  to  attempt 
additional  reforms. 

Packard  Initiatives 

The  military  spending  draw  down  in  the  late  1960s  enunciated  by  the  unpopular 
Vietnam  War  and  rising  cost  of  defense  acquisition,  prompted  David  Packard,  then 
Deputy  Secretary  of  Defense  (DEPSECDEF)  under  the  Nixon  Administration,  to 
recognize  that  the  government  needed  a  better  way  to  manage  the  procurement  of  weapon 
systems  and  reduce  cost  growth  (Eerrara,  1996:1 10).  In  1969,  Deputy  Secretary  Packard 
“returned  to  the  Services  much  authority  for  conducting  the  acquisition  process”  (Jones, 
1999:402).  He  believed  it  was  essential  for  the  individual  services  to  have  autonomy 
over  their  programs,  while  Office  of  Secretary  of  Defense  (OSD)  maintained  some 
program  oversight  (Pox  and  Pield,  1988:44).  To  ensure  careful  evaluation  and  informed 
decisions  were  made  before  a  program  proceeded  to  the  next  phase.  Secretary  Packard 
developed  the  Defense  Systems  Acquisition  Review  Council  (DSARC)  “to  advise  him  of 
the  status  of  each  major  defense  system”  (Pox  &  Pield,  1988:44).  The  group  was  also 
responsible  for  reviewing  the  management  practices  of  major  programs  to  determine  if 
reform  was  needed. 


10 


In  May  1970,  Secretary  Packard  released  a  memorandum  outlining  further 
changes  to  streamline  the  acquisition  process  and  reduce  cost  growth  (Fox  and  Field, 
1988:44).  Many  of  the  initiatives  in  Packard’s  memorandum,  such  as  decentralized 
program  execution,  streamlined  management  structures,  and  use  of  appropriate  contract 
mechanisms,  laid  the  foundation  for  the  first  DoD  Directive  5000.1,  “Acquisition  of 
Major  Defense  Systems”  (Ferrara,  1996:1 1 1).  Secretary  Packard’s  vision  as  outlined  in 
the  Directive  is  as  follows: 

Successful  development,  production,  and  deployment  of  major  defense  systems 
are  primarily  dependent  upon  competent  people,  rational  priorities,  and  clearly 
defined  responsibilities.  Responsibility  and  authority  for  the  acquisition  of  major 
defense  systems  shall  be  decentralized  to  the  maximum  practicable  extent 
consistent  with  the  urgency  and  importance  of  each  program. 

The  development  and  production  of  a  major  defense  system  shall  be  managed  by 
a  single  individual  (program  manager)  who  shall  have  a  charter  that  provides 
sufficient  authority  to  accomplish  recognized  program  objectives.  Layers  of 
authority  between  program  manager  and  his  Component  Head  shall  be 
minimum. . .  [the]  assignment  and  tenure  of  program  managers  shall  be  a  matter  of 
concern  to  DoD  Component  Heads  and  shall  reflect  career  incentives  designed  to 
attract,  retain,  and  reward  competent  personnel.  (Ferrara,  1996:1 1 1) 

The  final  section  of  DoDD  5000.1  contained  the  following  guidance: 

•  Wherever  feasible,  operational  needs  shall  be  satisfied  through  the  use  of 
existing  military  or  commercial  hardware; 

•  Practical  tradeoffs  shall  be  made  between  system  capability,  cost,  and 
schedule; 

•  Logistic  support  shall  be  considered  as  a  principal  design  parameter; 

•  Schedules  shall  be  structured  to  avoid  unnecessary  overlapping  or 
concurrency; 

•  Test  and  evaluation  shall  commence  as  early  as  possible; 

•  Contract  type  shall  be  consistent  with  all  program  characteristics,  including 
risk; 
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•  Source  selection  decisions  shall  take  into  account  the  contractor’s  capability; 

•  Develop  a  necessary  defense  system  on  a  timely  and  cost-effective  basis;  and 

•  Documentation  shall  be  generated  in  the  minimum  amount  to  satisfy 
necessary  and  specific  management  needs  (Ferrara,  1996:1 12). 

Under  this  directive,  program  managers  were  to  “be  given  adequate  authority  to 
make  major  decisions,  recognition  and  rewards  for  good  work,  and  more  opportunity  for 
career  advancement”  (Fox  and  Field,  1988:45).  However  promising  this  may  have 
seemed,  it  produced  few  encouraging  changes  within  the  military  services  and  established 
no  accountability  for  weapon  systems  cost  growth  (Fox  and  Field,  1988:  45).  Ironically, 
Secretary  Packard’s  visions  laid  forth  in  his  memorandum  over  30  years  ago  still  provide 
the  underlining  theme  of  current  acquisition  reform  initiatives. 

Blue  Ribbon  Defense  Panel  (Fitzhugh  Commission) 

While  many  of  the  previous  Executive-led  reform  studies  focused  on  government 
procurement  in  general,  the  Blue  Ribbon  Defense  Panel,  enacted  in  July  1969  by 
President  Nixon  due  to  strong  public  criticism  of  defense  procurement,  concentrated  on 
weapon  systems  acquisition.  The  Panel,  dubbed  the  Fitzhugh  Commission  after  its 
chairperson,  Gilbert  Fitzhugh,  issued  study  reports  that  were  “the  first  systematic 
evaluation  of  defense  acquisition  practices”  (Reeves,  1996:16).  The  commission  was 
explicitly  asked  to  comment  on  “defense  procurement  policies  and  practices,  particularly 
as  they  relate  to  costs,  time  and  quality”  (Bair,  1994: 1 1).  The  Panel  found  that  the 
department’s  excessive  centralization,  the  Secretary  of  Defense’s  large  span  of  control, 
and  the  many  layers  of  management  had  “contributed  to  serious  cost  overruns,  schedule 
slippages  and  performance  deficiencies”  (Fitzhugh  report,  1970:2).  Essentially,  the 
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commission’s  recommendations  were  the  undoing  of  many  of  the  centralized  business 
praetiees  initiated  by  Robert  McNamara  ten  years  earlier. 

In  addition  to  the  adviee  for  deeentralization,  the  Panel  aecentuated  the  need  for 
inereased  prototype  testing,  flexibility  in  ehoosing  an  aequisition  strategy,  more 
professional  development  of  aequisition  personnel,  and  expanded  authority  for  program 
managers.  The  report  further  reeommended  “that  fixed  priee  eontraets  should  not  be  used 
in  researeh  and  development  efforts”  beeause  of  the  “high  risks  and  many  teehnieal  and 
engineering  unknowns  assoeiated  with  these  efforts”  (Reeves,  1996:17).  Unfortunately, 
this  partieular  recommendation  was  not  aeeepted  by  the  DoD  and  resulted  in  the  near 
bankruptey  in  the  late  1980s  of  several  defense  eontraetors  aecepting  fixed  priee 
eontraets,  including  LTV  Corporation  and  Northrop  and  Grumman.  Ironically,  not  until 
after  these  ineidents  did  the  DoD  finally  deeide  against  the  use  of  fixed  priee  eontraets. 

Of  the  Panel’s  recommendations,  exelusive  of  the  non  use  of  fixed  priee  eontraets 
previously  deseribed,  most  were  embraeed  by  the  DoD  and  “virtually  mirrored”  (Bair, 
1994:13)  the  initiatives  established  by  David  Paekard.  Many  have  implied  that  the 
Panel’s  reports,  beeause  of  their  initiation  by  the  President  and  support  of  the  Congress, 
affirm  the  reeommendations  earlier  issued  by  Paekard.  However,  beeause  the  Panel’s 
reeommendations  were  left  to  the  DoD  to  implement  and  did  not  require  Congressional 
aetion,  few  of  the  initiatives  were  aetually  implemented.  In  fact,  similar 
recommendations  were  again  made  in  the  1985  Paekard  Commission  report,  raising  the 
question  of  implementation  effeetiveness  of  the  Panel’s  initiatives. 
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Commission  on  Government  Procurement 


All  previous  major  efforts  to  reform  the  aequisition  proeess  and  reduee  eost 
growth  were  direeted  by  either  the  Seeretary  of  Defense  or  the  President.  The 
Commission  on  Government  Proeurement  was  the  first  sueh  attempt  by  Congress  and 
was  designed  as  a  eomprehensive  review  of  all  government  buying  praetiees  and 
proeedures  (Bair,  1994:13-14).  The  ereation  of  the  eommission  was  prompted  by 
growing  eoneern  that  the  federal  proeurement  praetiees  were  ineffeetive  beeause  a  laek  of 
uniformity  and  an  inerease  in  eomplexity.  The  eommission’ s  initial  findings  revealed: 

•  Congress  was  ill-equipped  to  evaluate  performanee,  eosts,  and  sehedule  for 
new  defense  systems  programs  in  the  eontext  of  national  seeurity  objeetives 
and  priorities. 

•  Congress  should  establish  an  Offiee  of  Federal  Proeurement  Poliey  headed  by 
a  presidential  appointee  to  oversee  proeurement  polieies  and  systems. 

•  Congress  should  eonsolidate  all  statutory  proeurement  regulations  into  one. 

•  DoD  should  upgrade  the  aequisition  workforee  by  establishing  an  institution 
to  provide  neeessary  edueation  and  serviees. 

•  DoD  should  reduee  the  management  and  administration  layers  between  poliey 
and  program  offiees  (Fox  and  Field,  1988:45). 

The  eommission’ s  report  emphasized  how  uneoordinated  and  often  ineonsistent 
the  proeurement  regulations,  praetiees,  and  proeedures  were,  and  how  the  volumes  of 
expensive  paperwork  eontinued  to  inerease.  They  also  stressed  the  need  to  stem  the 
growing  proeurement  proeedure  eomplexity  to  make  doing  business  with  the  government 
easier.  The  eommission  reiterate  numerous  finding  from  the  Fitzhugh  eommission 
reports,  ineluding  the  use  of  eompetitive  negotiated  eontraet  methods,  eneouraging 
greater  use  multiyear  eontraets,  government-wide  professional  development  programs  for 
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procurement  personnel,  using  metries  to  report  the  progress  and  status  of  proposed 
ehanges,  raising  the  small  purehase  and  eeonomie  thresholds  from  $2,500  to  $10,000, 
introduee  an  independent  operational  test  and  evaluation  program,  and  inerease  the 
authority  of  program  managers  (Reeves,  1996: 18). 

Ironieally,  while  many  of  the  reeommendations  were  moves  in  the  right  direetion, 
pentagon  offieials  still  believed  that  DoD  had  already  made  internal  shifts  in  their 
proeurement  praetiees  from  reeommendations  made  earlier  by  the  Fitzhugh  eommission, 
and  that  more  time  was  needed  to  aeeess  their  results  before  additional  reforms  were 
implemented.  The  few  reeommendations  by  the  eommission  that  were  finally 
implemented  had  lasting  effeets  on  the  proeurement  proeess:  Offiee  of  Federal 
Proeurement  Poliey  ereated  (1974),  Contraet  Disputes  Aet  enaeted  (1978),  Federal 
Acquisition  Regulation  system  established  (1980),  Competition  in  Contraeting  Aet 
enaeted  in  (1984),  and  the  legislative  formation  of  the  Federal  Aequisition  Institute 
(1993)  (Bair,  1994:  15). 

Carlueei  Initiatives 

The  intensifying  Cold  War  eonfliet  fueled  the  defense  spending  inereases  during 
the  last  two  years  of  the  Carter  Administration,  and  President  Reagan’s  eampaign 
promise  for  aeeelerated  defense  buildup  (Benson,  1996:19).  The  rapid  inerease  in 
defense  spending  brought  with  it  a  new  round  of  ehanges  in  the  aequisition  proeess.  In 
1981,  in  order  to  manage  these  reforms,  Seeretary  of  Defense  Weinberger  ordered  the 
Aequisition  Improvement  Task  Foree;  also  know  as  the  Defense  Aequisition 
Improvement  Program  (DAIP)  or  the  Carlueei  Initiatives,  to  “evaluate  all  faeets  of 
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defense  aequisition”  (Jones,  1999:406).  The  team  was  headed  by  Deputy  Secretary  of 
Defense  Frank  C.  Carlucci. 

The  DAIP  released  a  list  of  32  management  initiatives,  aimed  at  decreasing 
weapons  cost,  reducing  development  time,  and  improving  weapons  support  and 
readiness.  Of  the  initiatives  proposed  in  Table  5,  multiyear  procurement  contracts, 
greater  contracting  competition,  stabilized  programs,  more  realistic  budgeting,  and  more 
fixed-price  contracts  were  eventually  established  and  instituted  by  DoD  (Fox  and  Field, 
1988:  47-48). 


Table  5,  Carlucci  Initiatives  (Adams,  1984, 15) 


1.  Reaffirm  Acquisition  Management  Principles  17. 

2.  Increase  Use  of  Preplanned  Product  18. 

Improvement  19. 

3.  Implement  Multiyear  Procurement  20. 

4.  Increase  Program  Stability  21. 

5.  Encourage  Capital  Investment  to  Enhance 

Productivity  22. 

6.  Budget  to  Most  Likely  Costs  23. 

7.  Use  Economical  Production  Rates  24. 

8.  Assure  Appropriate  Contract  Type  25. 

9.  Improve  System  Support  and  Readiness  26. 

10.  Reduce  Administrative  Costs  and  Time  27. 

11.  Budget  for  Technological  Risk 

12.  Provide  Front-end  Funding  for  Test  Hardware  28. 

13.  Reduce  Governmental  Legislation  Related  29. 

Acquisition  30. 

14.  Reduce  number  of  DoD  Directives  31 . 

15.  Enhance  Funding  Flexibility  32. 

16.  Provide  Contractor  Incentives  to  Improve  33. 

Reliability 


Decrease  DSARC  Briefing  and  Data  Requirements 
Budget  for  Inflation 
Forecast  Business  Base  Conditions 
Improve  Source  Selection  Process 
Develop  and  Use  Standard  Operation  and 
Support  Systems 

Provide  More  Appropriate  Design-to-Cost  Goals 
Implement  Acquisition  Process  Decisions 
Reduce  DSARC  Milestones 
Submit  MENS  (later  JMSNS)  with  Service  POM 
Revise  DSARC  Membership 
Retain  USDR&E  as  Defense  Acquisition 
Executive 

Raise  Dollar  Threshold  for  DSARC  Review 
Integrate  DSARC  and  PPBS  Process 
Increase  PM  Visibility  of  Support  Resources 
Improve  Reliability  and  Support 
Increase  Competition 
Enhance  the  Defense  Industrial  Base 

(added  1984) _ 


The  Carlucci  initiatives  addressed  some  of  the  longstanding  causes  of  cost 
growth,  and  many  of  the  themes  made  their  way  into  the  1982  revision  of  the  DoDD 
5000.1  series,  which  at  the  time  was  the  foundation  for  defense  acquisition  guidance 
The  revisions  reflected  the  principles  and  policies  recommended  by  the  Acquisition 
Improvement  Program,  and  are  evident  in  this  excerpt  from  the  1982  DoDD  5000.1 
version: 
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Improved  readiness  and  sustainability  are  primary  objeetives  of  the  aequisition 
proeess....  Reasonable  stability  in  aequisition  programs  is  neeessary  to  earry  out 
effeetive,  effieient,  and  timely  aequisitions.  To  aehieve  stability,  DoD 
Components  shall  eonduet  effeetive  evolutionary  alternatives,  estimate  and 
budget  realistieally,  [and]  plan  to  aehieve  eeonomieal  rates  of  produetion. 
(Ferrara,  1996:119) 

Carlueei  believed  that  in  order  for  the  ehanges  to  be  sueeessful,  DoD  not  only 
needed  proeurement  proeess  ehanges,  but  also  philosophieal  ehanges  to  eonfront  the 
“traditional  way  of  doing  business”  (Jones,  1999:407).  A  July  1996  GAO  report, 
assessing  the  effeetiveness  of  the  Carlueei  initiatives,  found  that  while  the  reforms  were 
at  least  partially  sueeessful  in  improving  parts  of  the  aequisition  proeess,  many  of  the 
program  managers  responsible  for  implementing  the  ehanges  felt  that  the  reforms  “had 
made  little  or  no  differenee  in  the  aequisition  proeess”  (Fox  and  Field,  1988:  48).  The 
report  suggested  that  the  “philosophieal”  ehanges  Carlueei  stressed  had  not  been  taken, 
and  “senior-level  eommitment  to  ehange  had  not  filtered  down  to  the  program 
management  level”  (Fox  and  Field,  1988:48).  GAO  further  emphasized  the  diffieulty 
with  implementing  the  reforms  in  an  environment  where  “everyone  was  in  a  hurry  to 
make  short-term  fixes”  (Jones,  1999:407).  Perhaps  the  most  telling  eomment  in  the 
GAO’s  report  was  the  pereeption  that  the  “eommitment  to  the  improvement  program  had 
dissipated”  (Muneehika,  1997:8).  While  only  five  years  had  passed  sinee  the  Carlueei 
initiatives  were  implemented,  DoD  lost  foeus  exeeuting  and  monitoring  the  results; 
ultimately  eontributing  to  a  pereeived  failure  in  the  reforms  (Holbrook,  2003:10). 

Graee  Commission 

During  President  Reagan’s  1980  eampaign  run,  he  pledged  to  reduee  federal 
budget  spending  by  two  pereent  through  the  identifieation  and  elimination  of  “waste. 
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extravagance,  abuse,  and  outright  fraud”  in  federal  programs  (Bair,  1994:16).  In  1982,  to 
follow  through  with  his  promise.  President  Reagan  established  the  President’s  Private 
Sector  Survey  on  Cost  Control  (PPSSCC),  also  known  as  the  Grace  Commission,  named 
after  its  chairperson,  Peter  J.  Grace.  The  group  consisted  of  161  chief  executive  officers 
of  major  corporations  and  private  sector  experts,  and  their  aim  was  to  identify  ways  the 
government  could  be  more  efficient  and  reduce  costs;  either  through  executive  or 
legislative  action  (Holbrook,  2003:10). 

The  Commission  recommended  2,478  government  reform  initiatives  to  the 
President,  with  estimated  cost  savings  of  $424  billion  over  three  years.  Of  the 
recommendations  only  112  pertained  directly  to  DoD,  and  of  these,  12  directly  involved 
the  acquisition  process  (US  Congress,  1984).  The  major  acquisition  reform  initiatives  are 
listed  in  Table  6: 


Table  6.  Grace  Commission  Recommendations  (House  Armed  Services  Committee, 

1985:3) 

1 .  Greater  use  of  multiyear  contracting  to  improve  program  stability 

2.  Prioritize  all  weapons  systems 

3.  Streamline  and  strengthen  the  contract  selection  process 

4.  Upgrade  cost  estimating 

5.  Enhance  the  role,  responsibility,  authority  and  accountability  of  the  PM 

6.  Increase  the  use  of  dual  sources,  throughout  the  life  of  the  program 

7.  Increase  emphasis  on  the  Spare  Parts  Breakout  Program  to  identify  and  obtain  spare  parts 
from  sources  other  than  the  Prime  Contractor 

8.  Consolidate  responsibility  for  contract  administration  activity  at  the  level  of  OSD 

9.  Simplify/streamline  the  30,000  pages  of  regulation  related  to  Defense  procurement 

10.  Mandate  use  of  common  components,  subsystems  and  equipment  by  all  services 

1 1 .  Eliminate  the  use  of  unnecessary  military  specifications 

12.  Outsource  commercial  functions 


The  main  focus  of  the  Commission’s  report  was  an  emphasis  on  “sound  business 
practices”  and  not  slashing  programs  (Bair,  1994:16).  The  report  identified  a  compelling 
need  to  modernize  and  streamline  the  acquisition  process,  and  overhaul  the  organization 
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structure  by  consolidating  the  procurement  function  at  the  OSD  level.  Once  again  the 

reform  theme  shifted  back  to  centralized  management,  as  recommended  by  McNamara 

more  than  twenty  years  before.  The  report  asserted: 

The  military  services  have  never  really  bought  into  the  need  for  central 
management  by  the  SECDEF. .  .Congress  continually  constricts  DoD’s 
management  prerogatives. .  .weapons  choices. .  .and  other  major  management 
decisions  cannot  be  made  in  isolation  from  home  district  political  pressures. 
(Grace  Report,  1983:11) 

Critics  of  the  Commission’s  claims  charged  that  the  estimated  potential  savings 
were  overstated  and  that  many  suggestions  were  not  improvements  in  efficiency  or 
eliminations  of  waste,  but  rather  characterized  as  changes  in  national  policy  (Bair, 
1994:17).  Opponents  of  the  proposals  suggested  that  congressional  policy  changes  were 
necessary  for  the  reforms  to  be  successful,  and  that  Congress  would  take  little  or  no 
action  to  ratify  any  recommendations.  In  addition,  numerous  senior  DoD  leaders 
believed  that  many  of  the  recommendations  were  already  being  addressed  and  that  the 
department  was  moving  in  the  right  direction  under  the  Carlucci  initiatives.  Ultimately, 
both  the  Grace  and  Carlucci  recommendations  lost  steam  and  faded,  while  cost  overruns 
continued  to  grow  (Munechika,  1997:12). 

Packard  Commission 

According  to  historical  budget  data  from  the  Congressional  Budget  Office, 
between  1980  and  1985  Defense  outlays  increase  over  88  percent.  With  the  tremendous 
increase  in  spending  came  several  highly  publicized  procurement  horror  stories  and  cost 
overruns  that  created  public  doubt  about  the  wisdom  of  DoD  weapon  systems  purchases 
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(Jones,  1999:398).  According  to  one  expert,  there  were  many  reasons  for  alarm  in  the 
Defense  acquisition  community: 

In  the  mid-1980s,  an  atmosphere  of  uncertainty,  frustration,  and  apprehension 
pervaded  the  Pentagon  and  its  contracting  base,  for  each  new  day  brought  with  it 
additional  regulations  and  concerns  that  more  errors  would  be  uncovered  by  either 
the  press  of  congressional  auditors,  investigators,  and  overseers...  the  logjam  of 
procurement  legislation  awaiting  implementation  had  become  so  great  that  the 
Pentagon  and  defense  industry  officials  pleaded  with  Congress  for  a  moratorium 
on  further  reform  legislation.  (Ferrara,  1996:1 19) 

In  an  effort  to  curb  growing  concern.  President  Reagan  responded  with  the 
formation  of  the  Blue  Ribbon  Commission  on  Defense,  better  know  as  the  Packard 
Commission,  named  after  its  chairperson,  former  Secretary  of  Defense  David  Packard 
(Benson,  1996:20).  The  Commission’s  mission  was  to  “examine  ways  to  improve 
defense  management  in  general,  and  defense  acquisition  specifically”  (Ferrara, 

1996:1 19).  Their  focus  was  on  “broad,  structural  changes  rather  than  on  the  smaller 
issues  of  fraud,  waste,  and  abuse,”  which  the  group  felt  were  symptoms  rather  than  the 
cause  of  the  problems  (Jones,  1999:407). 

Less  than  one  year  after  the  Commission  was  organized,  they  submitted  their  final 
report  to  the  President.  The  principal  recommendations  were: 

•  Create  a  new  position  of  Under  Secretary  of  Defense  for  Acquisition 
(USD[A])  with  responsibility  for  research,  development,  procurement  and 
testing  of  all  weapon  systems. 

•  Created  acquisition  executives  (AEs)  in  each  Service  reporting  to  both  the 
USD(A)  and  their  Service  Secretaries. 

•  Create  program  executive  officers  reporting  directly  to  the  AEs,  each 
overseeing  a  group  of  program  managers. 

•  Give  the  Chairman  of  the  JCS  more  authority  in  acquisition  matters,  create  a 
Vice  Chairman,  and  create  a  Joint  Requirements  Management  Board  to 
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establish  weapon  systems  requirements,  with  approval  or  rejeetion  authority  at 
eaeh  milestone  (Jones,  1999:407). 


In  addition  to  these  reeommendations,  the  Commission  developed  a  “model  of 
exeehenee  for  defense  aequisition,”  and  provided  a  “formula  for  aetion”  to  make  the 
proeess  more  efheient  (Munechika,  1997:13).  Table  7  shows  the  Paekard  Commissions 
Formula  for  Aetion. 

Table  7,  Packard  Commission’s  Formula  for  Action 

A.  Streamline  Acquisition  Organization  and  Procedures 

1 .  Create  new  Under  Secretary  of  Defense  for  Acqusition  position 

2.  Each  service  should  establish  a  comparable  Service  Acquisition  Executive  (SAE) 

3.  Each  SAE  should  appoint  Program  Executive  Officers  (PEO) 

4.  Program  managers  report  directly  to  PEOs 

5.  Substantially  reduce  the  number  of  acquisition  personnel 

6.  Recodify  federal  laws  into  a  single,  greatly  simplified  statute 

B.  Use  Technology  to  Reduce  Cost 

1.  Emphasize  building  and  testing  prototypes  to  demonstrate  new  technology 

2.  Operational  testing  should  begin  early  in  development 

3.  Prototypes  can  provide  a  basis  for  improved  cost  estimating 

C.  Balance  Cost  and  Performance 

1.  Restructure  Joint  Requirements  and  Management  Board  leadership 

2.  Joint  Requirements  Management  Board  should  define  weapon  requirements  and  provide 
tradeoff  between  cost  and  performance 

D.  Stabilize  Programs 

1.  Baseline  programs  and  use  multi-year  funding 

E.  Expand  the  Use  of  Commercial  Products 

1 .  Do  not  rely  on  military  specifications 

2.  Use  off-the-shelf  products  as  much  as  possible 

F.  Increase  the  Use  of  Competition 

1.  Focus  on  more  effective  competition,  modeled  on  commercial  practices 

2.  Emphasize  quality  and  past  performance  as  well  as  price 

G.  Enhance  the  Quality  of  Acquisition  Personnel 

1.  Allow  Secretary  of  Defense  to  establish  flexible  personnel  management  practices 

2.  Recommend  new  personnel  management  system  for  acquisition  personnel, 

contracting  officers  and  scientists  and  engineers 


Both  the  President  and  Congress  responded  very  enthusiastieahy  to  the 
reeommendations,  and  on  Oetober  1,  1986,  President  Reagan  signed  in  to  law  the 
Goldwater-Niehols  Department  of  Defense  Reorganization  Aet,  sweeping  ehanges  whose 
prineipal  provisions  were  to  implement  the  primary  Paekard  Commission’s  suggestions 
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(Jones,  1999:408).  Shortly  after  the  Commission’s  report  and  this  Aet,  DoD  ordered 
revisions  to  the  DoD  5000.1  series  to  eapture  the  efforts  in  the  basie  governing 
aequisition  regulation. 

In  1990,  a  USD(A)  report  analyzing  the  reform  progress  provided  speeifie 
positive  examples  of  inereased  eost  eontrol  and  stronger  program  stability: 

•  Multiyear  eontraeting.  Seven  multiyear  programs  were  approved  by  Congress 
in  the  FY  1989  budget,  saving  an  estimated  $492  million.  Total  savings  from 
multiyear  proeurements  from  FY  1982  to  FY  1989  exeeed  $7.5  billion. 

•  Eeonomie  produetion  rate.  Of  the  34  major  defense  acquisition  programs  in 
the  DoD,  30  were  planed  for  procurement  at  or  better  than  the  minimum 
economic  production  rate  (Munechika,  1997:15). 

After  various  progress  reports  on  the  Commission’s  results  were  positive,  and  key 
DoD  leadership  touted  the  reform  a  success.  President  Reagan’s  efforts  were  viewed  by 
some  as  the  most  substantive  defense  acquisition  reform  achievements  to  date  (Jones, 
1999:407).  However  successful  the  Packard  Commission’s  efforts,  they  still  were  not 
without  critics.  Many  argued  that  little  progress  was  made  enhancing  the  quality  of  the 
DoD  acquisition  personnel  (Munechika,  1997:15).  Also,  a  report  published  by 
Christensen  et  al.  (1999)  analyzing  the  Defense  Acquisition  Executive  Summary  data 
base  for  program  cost  growth,  showed  that  the  Packard  Commissions  results  did  not 
reduce  cost  overruns.  It  would  be  the  focus  of  the  Bush  Administration  to  aggressively 
investigation  the  “success”  of  the  Commission’s  efforts  upon  taking  office  in  1989 
(Holbrook,  2003:14). 


22 


Defense  Management  Review 

Early  in  1989,  President  Bush  direeted  Seeretary  of  Defense  Riehard  Cheney  to 
develop  a  plan  to  ensure  the  Paekard  Commission’s  reeommendations  were  fully 
implemented;  and  to  further  improve  and  more  effieiently  manage  the  defense  aequisition 
system  (Cheney,  1989:1).  The  DoD  in-house  study  was  ealled  the  Defense  Management 
Review  (DMR).  It  assessed  from  an  analytieal  view  how  far  along  the  DoD  was  in 
implementing  the  Commission’s  reeommendations,  and  what  remained  to  be 
aeeomplished  (Holbrook,  2003:14).  The  DMR’s  initial  findings  eritieized  management 
in  the  aequisition  eommunity  for  the  undiseiplined  management  proeess  and 
overburdening  regulations  (Ferrara,  1996:121).  The  Seeretary  released  a  list  of  ehanges 
that  must  be  taken  in  order  for  the  President’s  objeetives  at  improving  the  proeurement 
system  to  work: 

•  Teamwork  among  DoD’s  senior  managers; 

•  Sound,  longer-range  planning  and  better  means  for  managing  available 
resourees; 

•  More  diseipline  in  what  weapon  systems  we  buy  and  how  we  buy  them; 

•  Better  management  of  the  people  we  rely  on  to  produee  sueh  systems; 

•  An  environment  that  promotes  steady  progress  in  eutting  eosts  and  inereasing 
quality  and  produetivity;  and 

•  Adherenee  to  the  highest  ethieal  standards  (Cheney,  1989:27). 

DMR  also  instituted  a  list  of  improvements  that  ineluded  “streamlining  the 
aequisition  ehain-of-eommand  from  the  Defense  Aequisition  Exeeutive  through  a  newly 
ereated  Serviee  Aequisition  Exeeutive  (SAE)”,  having  the  Chairman  of  the  Joint  Chiefs 
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of  Staff  (JCS)  lead  the  Joint  Requirements  Oversight  Couneil  to  improve  requirements 
generation  and  enhanee  weapon  system  performanee  validation,  and  strengthening  the 
power  of  the  Under  Seeretary  for  Aequisition  (Hinnant,  1993:6;  Jones,  1999:404). 

By  the  end  of  1991  one  of  the  DMR’s  most  influential  initiatives,  entitled 
“Streamlining  Contraet  Management,”  had  been  implemented.  Its  aim,  a 
reeommendation  proposed  five  years  earlier  by  the  Graee  Commission;  was  to 
eonsolidate  the  Army,  Navy,  and  Air  Foree  eontraet  administrations  under  a  single 
organization  -  the  Defense  Logisties  Ageney  (DLA)  (Muneehika,  1997:16).  Also  in 
1991,  eame  the  release  of  the  overhauled  DoD  5000  series;  a  eoneerted  effort  to  respond 
to  the  DMR’s  eritique  (Ferrara,  1996:121).  The  four  main  objeetives  of  the  re-write 
were:  ereate  a  uniform  system  of  aequisition  poliey,  diseipline  the  aequisition 
management  proeess,  streamline  the  aequisition  regulatory  regime,  and  address  the  litany 
of  eommon  eomplaints  (Ferrara,  1996:121).  The  foeus  of  attention  in  the  aequisition 
proeess  after  the  DMR’s  reeommendation  was  a  shift  “to  a  more  formalized  report  based 
interaetion  in  whieh  all  neeessary  information  would  be  transmitted  in  writing”  (Ferrara, 
1996:121).  However,  this  method  would  later  be  reversed  beeause  of  an  inerease  in  “red 
tape”  and  “bureaueraey”,  whieh  slowed  down  the  aequisition  proeess. 

Summary 

This  seetion  provided  a  brief  overview  of  some  of  the  major  aequisition  reform 
initiatives  between  1960  and  1989.  From  a  historieal  point  of  view,  it  is  evident  that 
while  the  reform  studies  and  eommissions  have  ehanged  names,  many  of  the  ideas  and 
reeommendations  remained  the  same  between  MeNamara  (1961),  Paekard  (1969  to 
1970),  Fitzhugh  Commission  (1970),  Commission  on  Government  Proeurement  (1972), 
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Carlucci  Initiatives  (1981),  Grace  Commission  (1983),  Packard  Commission  (1986)  and 
the  Defense  Management  Review  (1989). 

Current  Acquisition  Reform  Overview  (1991  to  Today) 

This  section  defines  the  current  acquisition  reform  period  as  those  initiatives 
which  were  enacted  from  1991  to  2003.  This  section  examines  the  National  Performance 
Review  (NPR),  the  Federal  Acquisition  Streamlining  Act  (FAS A),  the  Clinger-Cohen  Act 
of  1996,  and  the  DoDD  5000  series  rewrites. 

National  Performance  Review  (NPR)  of  1993  and  1995 

The  National  Performance  Review  (NPR)  focused  on  transforming  the  current 
procurement  system  into  one  which  had  more  customer  service,  less  bureaucracy,  and 
was  primarily  based  on  getting  value  for  money  (Reinventing  Federal  Procurement, 
1993:7).  Five  major  themes  were  identified  and  provided  the  framework  for  20  specific 
reform  recommendations.  Table  8  identifies  the  five  major  NPR  themes  and  summarizes 
some  of  the  key  recommendations. 
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Table  8,  NPR  Procurement  Reform  Recommendations 
(Reinventing  Federal  Procurement,  1993) 


Move  to  Guiding  Principies  from  Rigid  Ruies 

PROC01  Reframe  Acquisition  Poiicy 

-  Reduce  ruies  and  reguiations 
PROC02  Buiid  an  Innovative  Procurement  Workforce 

-  Better  education  and  training 
PROC03  Encourage  More  Procurement  Innovation 

-  Test  new  methods  with  piiot  programs 
Get  Bureaucracy  Out  of  the  Way 

PROC04  Estabiish  New  Simpiified  Acquisition  Threshoid  and  Procedures 

-  Low  cost  procedures  for  smaii  purchases 
PROC06  Amend  Protest  Ruies 

-  Increased  communication  between  buyers  and  seiiers 
PROC08  Reform  Information  Technoiogy  Procurement 

-  Decrease  time  to  purchase  computer  equipment 
Center  Authority  and  Accountabiiity  with  Line  Managers 

PROC09  Lower  Costs/Reduce  Bureaucracy  in  Smaii  Purchases  though  Purchase  Card  Use 

-  IMPAC  Card  use 

Create  Competitive  Enterprises 

PROC12  Aiiow  for  Expanded  Choice  and  Cooperation  in  use  of  Suppiy  Scheduies 

-  Increase  Number  of  Supply  Sources 

Foster  Competitiveness,  Commerciai  Practices,  Exceiience  in  Vendor  Performance 

PROC13  Foster  Reliance  on  the  Commercial  Marketplace 

-  Reduce  reliance  on  government-specific  specifications 
PROC15  Encourage  Best  Value  Procurement 

-  Lowest  bidder  is  not  always  best! 

PROC16  Promote  Excellence  in  Vendor  Performance 

-  Use  past  performance  in  contract  award  decisions 
PROC18  Authorize  multiyear  contracts 


“In  December  1994,  President  Clinton  asked  Vice  President  Gore  to  conduct  a 
second  review  of  federal  agencies,  focusing  on  whether  existing  functions  could  be 
terminated,  privatized,  or  restructured”  (National  Partnership  for  Reinventing 
Government,  1999:4).  Commonly  referred  to  as  Reorganizing  Government  Phase  11 
(REGO  11),  this  second  review  featured  four  concurrent  efforts  which  are  outlined  in 
Table  9. 
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Table  9,  NPR  Phase  II  Procurement  Reform  Efforts  (Reinvention  Roundtable 

1995:6) 

Agency  Resturcturing  (considers  three  questions) 

-  If  your  agency  were  eliminated,  who  would  pusrue  its  goals? 

-  If  we  must  retain  this  federal  role,  how  can  we  improve  customer  service  and  reduce  costs? 

-  What  do  you  think  your  customers  think  about  eliminations  or  changes? 

Realigning  Relationship  of  Federal  Government  with  State/Local  Partners 

-  Pass  maximum  authority  and  funding  to  states,  localities,  and  individuals. 

-  If  federal  role  required,  the  federal  government  will  be  a  partner  who  "steers,  not  rows." 

Regulatory  Reform 

-  Regulators  must  change  the  regulatory  culture. 

Continued  Implementation  of  NPR  Phase  I 

-  Agencies  will  continue  to  build  on  successes  of  NPR  Phase  I 


Actual  NPR  savings  appear  to  be  eontested  between  federal  ageneies;  however, 
the  importanee  of  the  NPR  as  it  relates  to  this  study  was  that  it  reinvigorated  the 
Acquisition  Reform  movement  in  the  DoD  (Holbrook,  2003:15). 

Federal  Aequisition  Streamlining  Aet  (FAS A)  of  1994 

“The  Federal  Aequisition  Streamlining  Aet  of  1994  signifieantly  ehanged  how  the 
government  does  business.  As  part  of  Viee  President  Gore's  effort  to  ereate  a 
‘Government  That  Works  Better  and  Costs  Less’  within  his  National  Performanee 
Review,  he  presented  FAS  A  to  President  Clinton  in  1993.  It  was  designed  to  overhaul 
the  eumbersome  and  eomplex  proeurement  system  of  the  federal  government,  whieh 
required  eostly  paperwork  for  even  small  purehases  and  weeks,  sometimes  months,  of 
waiting  between  order  and  delivery  of  goods”  (FASA  DSMC,  2002).  To  this  end,  the  aet 
signifieantly  modified  or  eliminated  over  225  existing  statutes. 

“The  themes  behind  the  ehanges  made  by  FASA  are  a  preferenee  for  moving  to 
eommereial  eontraeting  methods,  transitioning  the  proeurement  proeess  to  an  eleetronie 
basis,  eliminating  paperwork  burdens  in  the  proeurement  eyele,  and  eliminating  non- 
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value-added  requirements”  (Statutory/Policy  Changes  1999:1).  Table  10  highlights  some 
of  the  ehanges  ineluded  in  the  FASA  of  1994. 

Table  10,  Federal  Acquisition  Streamlining  Act  of  1994  (FASA  DSMC,  2002) 

-  Eliminated  paperwork  and  record  keeping  requirements  for  purchases  under  $100,000 

-  Allowed  direct  micropurchases  of  items  below  $2,500 

-  Exempted  commercial  procurements  from  certain  cost  accounting  standards 

-  Reserved  all  acquisitions  ($2,500  -  $100,000)  for  small  business  concerns 

-  Expanded  Small  Disadvantaged  Business  program  to  civilian  agency  purchases 

-  Created  Small  Business  Procurement  Advisory  Council 

-  Improved  bid  protest  and  contract  administration  procedures 

-  Required  evaluation  of  past  performance  before  contract  award 

Clinger-Cohen  Act  of  1996 

In  1996,  Congress  and  the  President  enacted  the  Information  Technology 

Management  Reform  Act  and  the  Federal  Acquisition  Reform  Act,  which  are  jointly 

known  as  the  Clinger-Cohen  Act  of  1996.  Among  other  changes,  this  act  required  heads 

of  Federal  agencies  to  link  information  technology  (IT)  investments  to  agency 

accomplishments  and  establish  a  process  to  select,  manage,  and  control  IT  expenditures 

(Clinger-Cohen  Act  of  1996,  DSMC,  2001).  The  following  quote  by  former  Under 

Secretary  of  Defense  for  Acquisition  and  Technology,  Honorable  Paul  G.  Kaminski, 

summarizes  the  act’s  accomplishments. 

The  Clinger-Cohen  Act  of  1996  (formerly  known  as  the  Federal 
Acquisition  Reform  Act  of  1996  (FARA)  and  the  Information  Technology 
Management  Reform  Act  of  1996  (ITMRA))  further  advance  the  changes 
made  by  FASA.  The  Clinger-Cohen  Act  provides  a  number  of  significant 
opportunities  for  DoD  to  further  streamline  and  reduce  non-value  added 
steps  in  the  acquisition  process.  Among  the  most  significant  changes 
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authorized  by  the  Act  is  a  test  of  the  use  of  the  Simplified  Acquisition 
Procedures  (SAP)  for  commercial  items  between  the  simplified  acquisition 
threshold  of  $100,000  and  $5  million.  This  should  allow  DoD  to  reduce 
its  administrative  costs  and  overhead  costs  for  DoD’s  vendor  base  for 
purchases  of  relatively  low  risk  items.  This  change  eliminated 
government-unique  requirements  previously  cited  by  industry  as  a  barrier 
to  doing  business  with  DoD.  The  Act  also  provides  the  authority  for 
contracting  activities  to  use  SAPs  for  all  requirements  between  $50,000 
and  the  SAP  while  the  government  works  to  fully  implement  Electronic 
Commerce/Electronic  Data  Interchange  (EC/EDI).  (Clinger-Cohen 
DSMC,  2001) 

Overall,  changes  initiated  by  the  Clinger-Cohen  Act  provided  substantial  relief 
from  burdensome  non-value  added  processes  that  increased  the  cost  of  information 
technologies  acquisition  (Clinger-Cohen  DSMC,  2001). 

DoDD  5000  Series  Rewrites 


The  DoD  5000  Series  has  served  as  the  cornerstone  for  military  asset  acquisition 
since  the  1970s.  In  its  original  form,  the  5000  Series  “mandated  a  complicated 
acquisition  process  requiring  the  government  to  follow  specific  rules.  The  Series  also 
contained  supplemental  recommendations  and  suggested  guidelines  and  other  mandatory 
rules  that  applied  only  in  certain  circumstances.  The  process  was  very  detailed  but  was 
an  attempt  to  ensure  that  the  US  Government  purchase  only  the  highest  quality 
equipment”  (DoD  Directive  5000.1  and  5000.2-R  Rewrite,  2001);  however,  continued 
efforts  towards  a  more  efficient  acquisition  system  clearly  identified  the  need  to  revise 
the  Series. 

In  1997,  the  first  drastically  revised  5000  Series  was  released  to  realign 
acquisition  guidelines  with  current  legislation.  The  rewrite  focused  on  the  following  four 
streamlined  acquisition  processes. 
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•  It  incorporated  new  laws  and  policies. 

•  It  separated  mandatory  policies  and  proeedures  from  discretionary  praetices. 

•  It  reduced  the  volume  of  internal  regulatory  guidance. 

•  It  integrated,  for  the  first  time  ever,  aequisition  polieies  and  procedures  for 
both  weapon  systems  and  automated  information  systems.  (DoD  Directive 
5000.1  and  DoD  5000.2-R  Rewrite,  DSMC,  2001) 

This  newly  revised  DoD  5000  series  was  dramatieally  simplified,  going  from  more  than 

1,000  pages  in  its  original  form  to  merely  160  pages  with  this  revision. 

In  2002  the  5000  series  was  again  radieally  modified.  This  time  the  entire 
publieation  was  suspended  from  use  until  a  more  flexible  guideline  could  be  ereated.  In  a 
Oetober  30,  2002  memorandum,  Underseeretary  of  Defense  Wolfowitz  canceled  the  DoD 
5000  Defense  Aequisition  Policy  Documents  stating  “I  have  determined  that  the  current 
subjeet  doeuments  require  revision  to  ereate  an  aequisition  policy  environment  that 
fosters  efficiency,  flexibility,  ereativity,  and  innovation”  (Wolfowitz,  2002). 

A  new  DoD  5000  series  emerged  in  2003  to  satisfy  the  functional  criteria 
established  by  Undersecretary  Wolfowitz.  Sinee  the  2003  revision  exeeeds  the  scope  of 
this  researeh,  the  details  will  not  be  diseussed  in  this  report. 

Summary 

Current  period  reform  initiatives  are  not  much  different  than  their  predecessors,  as 
the  push  to  eliminate  bureaucraey  for  more  effective  aequisition  seems  to  permeate  from 
decade  to  decade.  From  one  eurrent  reform  initiative  to  another,  commonalities  include 
streamlining  regulatory  guidelines,  implementing  commercial  practices,  and  providing 
the  end-user  more  flexibility. 
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Cost  Growth  Studies 


This  section  summarizes  recent  research  studies  that  focus  on  quantifying  cost 
growth  in  DoD  acquisition  and  measuring  the  effectiveness  of  acquisition  reform 
initiatives.  These  studies  provide  the  motivation  and  methodology  for  this  research 

1993  Drezner  Study 

The  Drezner  study  attempted  to  identify  the  extent  of  a  historical  cost  growth 
problem  in  DoD  acquisition  by  focusing  on  two  primary  research  objectives: 

•  Quantify  the  magnitude  of  cost  growth  in  weapon  systems. 

•  Identify  factors  affecting  cost  growth. 

Utilizing  the  Selected  Acquisition  Reports  (SAR)  as  of  December  1990,  a 
database  of  197  major  weapon  systems  was  compiled  for  cost  growth  analysis.  Two 
significant  findings  resulted  from  this  study.  First,  the  researchers  found  “no  substantial 
improvement  in  average  cost  growth  over  the  last  30  years,  despite  the  implementation  of 
several  initiatives  intended  to  mitigate  the  effects  of  cost  risk  and  the  associated  cost 
growth.  In  fact,  [their]  results  suggest  that  cost  growth  has  remained  about  20  percent 
over  this  time  period”  (Drezner  1993:xiv).  Second,  “researchers  could  not  definitely 
account  for  the  observed  cost  growth  patterns.  Thus,  no  ‘silver  bullet’  policy  option  is 
available  for  mitigating  cost  growth”  (Drezner  1993:xi);  however,  “the  two  factors  that 
have  the  greatest  effect  on  total  program  cost  growth  are  program  size  and  maturity” 
(Drezner  1993:xii). 

The  1993  Drezner  study  identified  troubling  results  about  cost  growth  in  the  DoD 
acquisition  process.  To  determine  if  the  cost  growth  pattern  continues  through  2001,  the 
RAND  study  is  utilized  as  the  template  for  this  thesis  research. 
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1999  Christensen  et  al.  Study 

The  research  of  Christensen  et  al.  added  further  support  for  the  20  percent  average 
annual  cost  growth  identified  in  the  1993  Drezner  report,  finding  similar  results  with  the 
Defense  Acquisition  Executive  Summary  (DAES)  database  as  Drezner  found  with  the 
SAR  database  (Christensen  et  al.  1999:251).  More  specifically,  this  study  analyzed  an 
eight  year  window  around  the  implementation  of  the  Packard  Commission’s 
recommendations  to  determine  if  cost  growth  improved  because  of  these  reform  efforts. 
Their  research  identified  that  the  Packard  Commission’s  recommendations  “did  not 
reduce  the  average  overrun  percent  experienced  on  269  completed  defense  acquisition 
contracts  over  an  eight  year  period  (1988  through  1995).  In  fact,  the  cost  performance 
experienced  on  development  contracts  and  on  contracts  managed  by  the  Air  Eorce 
worsened  significantly  (Christensen  et  al.  1999:251).  Eailure  of  the  Packard 
Commission’s  recommendations  to  control  cost  growth  as  designed  reveals  the  need  for 
continued  monitoring  of  newly  implemented  acquisition  reform  efforts. 

2003  Holbrook  Thesis 

The  Holbrook  study  “focuses  on  the  timeline  of  current  reform  initiative 
implementation,  with  an  emphasis  on  cost  reduction-focused  initiatives.  This  study 
assessed  whether  DoD  weapon  system  contract  cost  performance  was  improving  or  not 
and  how  any  cost  performance  trends  (positive  or  negative)  relate  to  the  implementation 
timeline”  (Holbrook  2003,  3).  The  use  of  the  DAES  database  enabled  Holbrook  to  apply 
earned  value  management  calculations  to  assess  cost  growth.  Although  Holbrook  used  a 
different  database  and  methodology  than  those  applied  in  this  study,  his  research  provides 
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a  unique  perspective  into  the  correlation  of  cost  growth  and  acquisition  reform. 

Holbrook’s  thesis  is  based  on  two  specific  research  objectives: 

First  to  determine  if  a  mapping  between  cost  initiatives  and  cost  growth 
improvement  exists  and  if  so,  what  is  the  time  period  between  implementation  of 
an  initiative  and  the  results.  Second,  based  on  this  relationship  the  focus  will  be 
on  developing  a  model  or  ‘rule  of  thumb’  to  estimate  or  forecast  an  impact 
window  or  time  frame  in  which  to  expect  results  for  future  cost-related  acquisition 
reform  policies.  (Holbrook  2003,  4) 

His  research  focused  on  204  contracts  completed  between  January  1,  1994  and 
December  31,  2001  (Holbrook  2003,  xi).  The  analysis  identified  that  cost  growth  was  no 
different  in  contracts  completed  after  acquisition  reform  implementation  than  it  was  in 
those  contracts  completed  before  acquisition  reform  implementation.  In  addition,  the 
research  investigated  cost  performance  on  all  active  contracts  from  1970  to  2002  with 
acquisition  reform  studies  and  commissions  over  the  same  time  period  to  examine  any 
trends  or  time  lags  between  reform  implementation  and  contract  cost  performance 
change.  The  study  results  “indicate  some  evidence  of  cost  performance  change  following 
the  different  studies  and  commissions”  (Holbrook  2003,  xi). 

Chapter  Summary 

This  chapter  defined  aircraft  weapon  systems  and  specified  their  relative  impact 
on  the  DoD  budget.  The  chapter  also  identified  the  long  history  of  acquisition  reform 
initiatives  up  to  2003,  revealing  the  legislative  impact  on  the  DoD  acquisition  process. 
Finally,  recent  cost  growth  studies  were  reviewed  to  establish  a  baseline  viewpoint  on  the 
extent  of  weapon  system  cost  growth  in  the  DoD. 

This  thesis  utilizes  the  past  cost  growth  studies  identified  above  to  identify  if  cost 
growth  is  still  plaguing  the  DoD  acquisition  process  today.  Hypothesizing  that  cost 
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growth  will  be  found  in  the  aireraft  weapon  systems  from  1991  to  2001,  further  analysis 
will  be  performed  to  identify  if  aequisition  reform  initiatives  have  made  any  impaet  on 
redueing  the  amount  of  cost  growth  a  program  incurs.  The  methodology  for  this  research 
is  described  in  Chapter  III. 
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III.  Methodology 


Chapter  Overview 

Two  fundamental  questions  arise  when  performing  weapon  system  eost  growth 
analysis:  1)  how  to  aoeurately  quantify  eost  growth,  and  2)  whether  or  not  aequisition 
reform  initiatives  have  made  a  differenee  on  weapon  system  cost  growth.  The  issue  of 
cost  growth  calculation  centers  on  what  adjustments  must  be  made  to  normalize  for 
inflation,  changes  in  baseline  quantities,  and  the  phenomenon  of  cost  improvements  with 
increasing  production  quantities.  To  determine  if  acquisition  reform  has  impacted  cost 
growth,  pre-reform  and  post-reform  periods  of  analysis  must  be  identified.  This  chapter 
gives  a  description  of  the  database  and  data  used,  explains  the  adjustments  and 
calculations  of  cost  growth,  and  explains  the  phases  of  analysis  conducted. 

Data  Collection 

The  cost  growth  analysis  research  relied  on  data  from  Selected  Acquisition 
Reports  (SAR),  which  are  the  primary  documents  submitted  by  the  Department  of 
Defense  (DoD)  to  Congress  regarding  the  status  of  major  defense  acquisition  programs 
(MDAP)  (Jarvaise  et  ah,  1996:3).  To  minimize  interpretive  errors,  this  study  used  the 
Office  of  the  Secretary  of  Defense  (OSD)  Cost  Analysis  Improvement  Group  (CAIG) 
cost  growth  database.  The  OSD  CAIG  database  compiles  all  historical  SAR  data  into  a 
Microsoft  Excel  workbook,  while  incorporating  expert  judgment  in  classifying  many 
areas  that  are  reliant  on  interpretation,  such  as  quantity-related  cost  variances.  This 
electronic  database  not  only  facilitates  specific  program  data  extraction,  but  also 
mitigates  some  SAR  limitations  discussed  in  Chapter  I. 
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MDAPs  reporting  SARs  are  acquisition  programs  that  are  “not  highly  sensitive 
classified  programs”  as  determined  by  the  Secretary  of  Defense  but  are; 

•  Designated  by  the  Secretary  of  Defense  as  a  MDAP,  or 

•  Estimated  by  the  Secretary  of  Defense  to  require  an  eventual  total  expenditure 
of  more  than  $300  million  (based  on  fiscal  year  1990  constant  dollars)  or  an 
eventual  total  expenditure  for  procurement  of  more  than  $1.8  billion  (based  on 
fiscal  year  1990  constant  dollars)  (10  U.S.C.,  2430). 

SARs  are  developed  by  the  Program  Management  Offices  (PMOs)  and  provide 
data  on  the  cost,  schedule,  and  performance  status  of  MDAPs  at  regular  intervals 
(Jarvaise  et  ah,  1996:3).  Annual  SARs  are  mandatory  for  MDAPs  60  days  after  the  date 
on  which  the  President’s  Budget  is  submitted  to  Congress,  and  cover  data  as  of  3 1 
December.  Quarterly  SARs  are  reported  on  an  exception  basis  if  the  program  meets  the 
following  criteria: 

•  1 5%  or  more  increase  in  the  procurement  estimate  of  the  Program  Acquisition 
Unit  Cost  (PAUC)  compared  to  the  PAUC  in  the  currently  approved 
Acquisition  Program  Baseline  (APBA),  or 

•  15%  or  more  increase  in  the  current  estimate  of  the  Average  Procurement  Unit 
Cost  (APUC)  compared  to  the  APUC  in  the  currently  approved  APB,  or 

•  Six-month  of  greater  delay  in  the  current  estimate  of  any  schedule  milestone 
since  the  current  estimated  reported  in  the  previous  SAR,  or 

•  Milestone  B,  Milestone  C,  or  Full  Rate  Production  Decision  Review 
(Milestones  II  or  III  for  grandfathered  programs)  and  associated  APB 
approval  within  90  days  prior  to  the  quarter  end  date  (DoD  5000.2-1). 

Data  used  in  this  study  is  from  the  1991  through  2001  annual  aircraft  weapon 
system  SAR  reports  and  is  current  as  of  December  2001.  The  schedule,  technical,  and 
cost  information  listed  in  the  SAR  is  reported  in  terms  of  “baseline,  approved  program, 
and  current  estimates”  (Jarvaise  et  ah,  1996:3).  For  the  purpose  of  this  research  the 
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sections  on  program  acquisition  costs,  which  include  “all  such  costs  from  program 
inception  to  completion  regardless  of  the  program’s  stage  of  development”  (Hough, 
1992:4),  are  of  interest  and  used  in  the  data  collection  and  analysis. 

Two  estimates  of  cost  are  provided  in  a  SAR  and  are  allocated  to  the  following 
appropriations:  Development  (RDT&E),  procurement,  and  military  construction 
(MILCON).  The  first  cost  is  a  baseline  estimate  that  can  be  made  for  each  of  the  three 
Milestones:  Milestone  I  (A)  or  the  planning  estimate  (PE),  Milestone  II  (B)  or  the 
development  estimate  (DE),  and  Milestone  III  (C)  or  production  estimate  (PE)  (Hough, 
1992:4).  The  second  is  “the  current  estimate  that  includes  actual  schedule,  technical,  and 
cost  information  for  the  most  recent  estimate  available”  (Jarvaise  et  ah,  1996:3).  The 
costs  are  reported  in  both  base  year  (BY)  and  then  year  (TY)  dollars  in  millions.  The  DE, 
or  Milestone  II  (B)  estimate,  is  associated  with  the  Engineering  and  Manufacturing 
Development  (EMD)  start,  and  has  been  the  most  common  baseline  for  calculating  cost 
growth: 

Eor  many  types  of  descriptive  and  statistical  analyses,  cost  growth  is  referenced  to 
the  DE  baseline  since  prior  to  Milestone  2  (B),  capability  and  configuration  trade¬ 
offs  are  often  still  in  the  process  of  being  resolved.  Using  this  baseline  also 
establishes  a  weapon  system  of  reasonably  constant  scope  in  cost  growth 
analyses.  (Jarvaise  et  ah,  1996:  12) 

Therefore,  the  Milestone  II  (B)  estimate  is  used  as  the  baseline  in  this  research. 

Einally,  a  change  in  the  quantity  of  weapon  systems  from  baseline  to  current 
estimates  is  reported  each  year  in  the  program  acquisition  cost  section  of  the  SAR,  and 
identifies  the  quantity  of  weapon  systems  to  be  procured  for  the  given  estimate  as  well  as 
the  baseline  estimate  (Hough,  1992:4).  Data  from  this  section  of  the  SAR  report  is  used 
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when  making  quantity  normalization  adjustments  covered  in  the  Phase  One  section  of  the 
methodology. 

Phase  I 

Research  Objective 

Chapter  II  outlined  a  1993  RAND  report  that  measured  MDAP  cost  growth  from 
the  mid-1960s  to  1990  using  SARs.  The  research  revealed  that  the  average  cost  growth 
for  all  weapon  systems  was  around  20  percent,  while  aircraft  systems  averaged  28 
percent.  To  get  a  current  measure  of  the  state  of  aircraft  weapon  system  cost  growth,  this 
phase  of  the  study  measures  cost  growth  using  aircraft  system’s  SARs  from  1991  to 
2001. 

Population  and  Sample 

The  data  population  for  this  research  encompasses  all  aircraft  weapon  systems 
whose  primary  motivation  is  airframe  production  that  reported  SARs  during  1991  to 
2001 .  The  samples  selected  from  this  population  for  Phase  I  includes  only  those 
programs  with  a  reported  Milestone  II  baseline.  A  total  of  78  aircraft  weapon  system 
SARs  are  included  in  this  research. 

Data  Normalization 

Generally,  cost  growth  is  identified  as  the  change  between  the  baseline  estimate 
and  the  current  estimate.  There  are  two  primary  approaches  to  measuring  cost  growth: 
unadjusted  costs  and  adjusted  costs.  The  unadjusted  method  measures  cost  growth  in  TY 
dollars  and  excludes  any  changes  in  procurement  quantity  or  inflation.  The  unadjusted 
procedure  is  used  when  measuring  the  impact  of  cost  growth  on  the  federal  budget  and  is 
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favored  by  the  General  Aecounting  Office  (GAO)  and  Congress  “because  it  reflects  the 
budgetary  impact  of  all  program  cost  changes  regardless  of  what  conditions  are 
responsible  for  the  change”  (Hough,  1992:  10).  Adjusted  cost  growth  is  calculated  in 
constant  year  (CY)  dollars  to  eliminate  the  effects  of  inflation,  and  accounts  for  changes 
in  procurement  quantities.  The  adjusted  cost  growth  approach,  which  is  modified  and 
used  in  this  research,  is  preferred  when  “determining  how  well  program  management  has 
done  in  estimating  and  controlling  costs”  within  its  weapon  system  program  (Drezner  et 
ah,  1993:10). 

A  hybrid  adjusted  cost  growth  method  is  applied  in  this  research,  which  adjusts 
procurement  costs  by  deducting  the  primary  and  secondary  quantity-related  variances 
reported  in  the  SAR  and  then  normalizes  the  residual  procurement  variance  along  a  cost- 
quantity  learning  curve  (Hough,  1992:39-40).  An  explanation  of  the  process  is  provided 
in  the  following  paragraphs. 

Inflation  Adjustment 

The  initial  step  in  adjusting  cost  data  using  SARs  is  to  remove  the  effects  of 
inflation,  which  are  outside  the  control  of  weapon  system  programs  and  serve  only  to 
disguise  the  true  level  of  cost  growth  when  left  unadjusted.  The  SAR  provides  data  in 
both  BY  and  TY  dollars,  so  the  effects  of  inflation  can  be  overcome  by  extracting  cost 
data  and  calculating  cost  growth  factors  in  BY  dollars  (Jarvaise  et  ah,  1996:20). 

However,  a  common  occurrence  within  the  SARs  is  that  the  baseline  may  change  for  a 
particular  program.  Therefore,  to  perform  cost  growth  analysis  that  will  remain 
consistent  throughout,  all  data  calculations  must  be  adjusted  to  a  CY,  thus  eliminating  the 
effects  of  changing  baselines  and  inflation  by  removing  changes  in  the  value  of  money 
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over  time  (Drezner  et  al.,  1993:21).  All  values  in  this  research  are  adjusted  by  applying 
the  OSD  CY  2000  inflation  indices,  and  shown  in  dollars  in  millions. 

Quantity  Adjustment 

After  the  inflation  adjustments  have  been  made  the  next  step  in  normalizing  the 
data  is  to  remove  the  effects  of  quantity  changes  from  the  baseline  estimate.  While 
adjusting  for  inflation  is  fairly  straightforward,  the  same  cannot  be  said  for  quantity 
normalization;  it  is  critical  to  explain  exactly  how  the  calculations  are  accomplished. 
General  steps  and  formulas  for  calculating  adjusted  cost  growth  are  provided  in  this 
chapter  along  with  adjusted  cost  growth  calculations  using  F-22  SAR  data,  as  of 
December  2001,  to  illustrate  the  use  of  this  model  in  practical  context.  In  addition,  all 
aircraft  weapon  system  adjusted  cost  growth  and  learning  curve  calculations  are  provided 
in  Appendices  A  to  N. 

Before  initial  adjustments  are  made,  it  must  first  be  decided  whether  to  recalculate 
the  current  estimate  to  the  baseline  quantity  or  to  adjust  the  baseline  quantity  to  the 
current  quantity.  When  normalizing  to  the  current  quantity,  a  floating  baseline  is  created 
as  the  procurement  quantity  changes,  which  can  lead  to  contrasting  measures  of  cost 
growth  when  there  are  large  changes  in  the  production  quantity.  On  the  other  hand, 
normalizing  to  the  baseline  quantity  will  “theoretically  give  the  same  cost-growth  factor 
whether  subsequent  quantities  are  increased  or  decreased”  (Hough,  1992:  30).  This 
method  is  approved  and  used  by  most  research  firms  conducting  cost  growth  analysis, 
and  is  therefore  adopted  for  this  study. 
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Once  a  normalization  quantity  has  been  seleeted,  the  first  proeedure  for  adjusting 
the  quantity  is  to  oaleulate  the  eurrent  proeurement  varianee  (CPV).  This  is 
aeeomplished  by  subtraeting  the  baseline  proeurement  estimate  (BPROC)  from  the 
eurrent  proeurement  estimate  (CPROC)  as  expressed  by  Equation  1  (Leonard,  2003). 

CPV  =  CPROC  -  BPROC  ( 1 ) 

F-22  CPV  oaleulations  inflated  to  CY  2000  dollars  in  millions  from  2001  SAR: 

-15097.34  =  37173.40  -  52270.74 

The  seeond  step  is  to  oaleulate  the  eurrent  and  oumulative  quantity-related  oost 
varianoes  assooiated  with  proeurement  estimates  from  Seotion  13  of  the  SAR.  The 
varianoes  in  “RDT&E  and  military  oonstruotion  are  not  normalized  beoause  they  are 
usually  (but  not  always)  independent  of  ohanges  in  the  proeurement  quantity”  (Hough, 
1992:  33).  There  are  two  types  of  quantity  related  oost  varianoes  that  must  be  oonsidered; 
primary  and  seoondary. 

Primary  quantity-related  oost  varianoes  (PQRCV)  are  oosts  inoreases  or  deoreases 
that  are  direotly  attributed  to  a  quantity  ohange,  and  are  identified  in  Seotion  13  of  the 
SAR  under  the  oost  varianee  oategory  “Quantity.”  Seoondary  quantity-related  oost 
varianoes  (SQRCV)  are  known  oosts  effeots  of  a  quantity  ohange,  suoh  as  an  inorease  in 
initial  spare  parts  as  a  result  of  inorease  in  proeurement  quantity  that  are  not  direotly 
related  with  the  end  item,  and  thus  not  reported  in  the  “Quantity”  oategory  (Hough,  1992: 
31).  The  seoondary  quantity  effeots  are  reported  under  the  sohedule,  engineering,  and 
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estimating  cost  variances  categories  and  can  be  subjectively  identified  as  resulting  from  a 
quantity  change  by  reading  the  current  variance  narrative  explanations  in  Section  13  of 
the  SAR.  The  SAR  database  provided  by  OSD  identified  the  secondary  quantity-related 
variances  extracted  from  the  SAR  cost  variance  narratives,  and  this  thesis  makes  use  of 
those  values. 

Once  the  primary  and  secondary  quantity-related  variances  are  identified,  a  total 
quantity-related  cost  variance  (TQRCV)  is  calculated  by  summing  the  primary  and 
secondary  quantity-related  variances  for  each  year  as  shown  in  Equation  2  (Leonard, 
2003). 


TQRCV  =  PQRCV  +  SQRCV  (2) 

F-22  TQRCV  calculations  inflated  to  CY  2000  dollars  in  millions  from  2001 

SAR: 


269.55  =  262.54  +  7.01 


A  total  quantity-related  cumulative  cost  variance  (TQRCVcum)  must  then  be  calculated  by 
summing  the  TQRCV  for  all  previous  years  as  shown  in  Equation  3  (Leonard  2003). 


TQRCVcum  =  Y.TQRCV,  (3) 
1 

i  =  the  ith  year  in  sample 
n  =  total  number  of  years  in  the  sample 


F-22  TQRCVcum  inflated  to  CY  2000  dollars  in  millions  from  2001  SAR: 
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TQRCVcum  = -20421.92 


The  third  step  is  to  calculate  a  net  procurement,  or  residual  variance  (RV),  by 
subtracting  the  quantity-related  variance  from  the  total  procurement  variance.  The 
residual  variance  is  the  difference  between  the  baseline  estimate  and  current  estimate 
after  quantity-related  costs  are  removed.  In  essence,  residual  variance  is  non-quantity- 
related  cost  variance  and  is  expressed  by  Equation  4  (Leonard,  2003). 

RV  =  CPV  -  TQRCVcum  (4) 

F-22  RV  calculations  inflated  to  CY  2000  dollars  in  millions  from  2001  SAR; 

5324.58  =  -15097.34  -  -20421.92 

The  fourth  normalization  step  is  to  calculate  the  production  learning  curve  slope 
(ECS)  and  theoretical  first  unit  cost  (Tl).  These  calculations  are  performed  using  the 
cumulative  average  learning  curve  theory  methodology  for  lot  data.  Cumulative  average 
learning  curve  for  lot  data  generally  entails  applying  linear  regression  to  the  cumulative 
cost  of  producing  a  cumulative  number  of  units.  The  production  learning  curve  and  Tl 
are  created  from  the  regression  output.  The  ECS  is  “the  constant  factor  by  which  cost 
decreases  as  the  production  units  double  and  is  usually  expressed  as  a  percentage” 
(SCEA,  2002:6).  This  concept  is  shown  in  Figure  2. 
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Learning  Curve  Concept 


Quantity 


Figure  2,  Cumulative  Average  Learning  Curve  Slope  (McCrillis,  2003) 

Normalizing  using  the  LCS  affects  the  data  by  either  increasing  or  decreasing  the 
amount  of  a  program’s  cost  variance.  A  weapon  system’s  baseline  cost  “is  established 
assuming  a  specific  quantity  of  units.  As  the  number  of  units  increases,  the  unit  cost  will 
go  down  even  though  the  program  cumulative  total  cost  increases.  As  the  number  of 
units  decreases,  the  unit  cost  increases  even  though  the  program  cumulative  total 
decreases”  (McCrillis,  2003).  This  concept  is  shown  in  Figure  3  for  a  notational  baseline 
program. 
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— Higher  UC  Program 
— Baseline  Program 
— ^  Lower  UC  Program 


Quantity  (#) 


Figure  3,  Baseline  Program  Normalization  (McCrillis,  2003) 

The  lines  above  and  below  the  baseline  program  line  in  Figure  3  represent 
programs  with  positive  and  negative  cost  growth.  The  significance  of  adjustment 
depends  on  the  “percentage  of  quantity  change,  how  early  in  the  program  the  quantity 
changed,  the  direction  of  the  quantity  change,  and  the  steepness  of  the  slope”  (Flough, 
1992:35). 

To  access  whether  a  program  has  experienced  cost  growth  or  cost  reductions,  the 
variances  must  be  normalized  back  to  the  baseline  quantity.  The  basic  steps  for 
determining  a  LCS  are  listed  below: 

•  Gather  available  data  and  normalize  it  (e.g.,  convert  to  CY  dollars),  as 
necessary; 

•  Perform  any  necessary  operations  on  the  data  and  transform  into  log  space; 

•  Plot  the  data  to  determine  if  learning  curve  analysis  is  suitable  (should 
approximate  a  line  in  log  space); 
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•  Determine  the  log-spaee  linear  equation,  generally  using  ordinary  least 
squares  (OLS)  regression; 

•  Transform  the  result  back  into  unit  space;  and 

•  Finally,  calculate  your  answers  (SCEA  Module  7,  2002: 11). 

Data  required  for  developing  a  ECS  is  provided  in  the  procurement  breakout  of 
Section  16  (Program  Eunding  Summary)  in  the  SAR.  This  section,  which  became 
regularly  available  beginning  with  the  December  1985  SAR,  displays  the  fiscal-year 
procurement  quantities  and  funding  numbers  for  both  completed  (i.e.,  “actual”)  and 
future-years  production.  In  some  cases,  limiting  the  ECS  calculations  to  completed 
production  years  will  result  in  an  insignificant  number  of  data  points.  Therefore,  the 
preferred  method  is  to  use  the  entire  procurement  breakout,  with  both  completed  and 
projected  production  cost  and  quantities,  which  will  produce  more  realistic  and  robust 
total  cost-quantity  curves.  In  addition,  when  developing  a  ECS  to  normalize  the  current 
estimate  to  the  baseline  quantity,  the  current  estimated  Program  bunding  Summary  data 
from  the  most  recent  SAR  should  be  applied  (Hough,  1992:  34). 

Once  Program  bunding  Summary  data  has  been  assembled  from  Section  16  of  the 
SAR,  the  cumulative  average  unit  cost  (CAUC)  and  cumulative  units  produced  (CUP) 
must  be  calculated  for  each  year.  The  CAUC  is  calculated  by  summing  the  cost  of  all 
lots  up  to  and  including  the  current  one  and  then  dividing  by  the  CUP.  The  CAUC  and 
CUP  must  then  be  transformed  into  log  space  (SCEA,  2002:19). 

The  next  step  is  to  plot  the  log-space  data  using  a  scatter  plot  to  determine  if  the 
data  reasonably  approximates  a  straight  line.  The  In(CUP)  is  plotted  on  the  horizontal 
axis  and  the  In(CAUC)  on  the  vertical  axis  (SCEA,  2002:14).  Eor  normalizing  cost 
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growth  data,  a  coefficient  of  determination  of  0.70  or  higher  is  generally  accepted 
(Hough,  1992:39),  and  goodness  of  fit  regression  statistics  can  be  used  to  determine  if  the 
data  is  statistically  significant.  In  any  case  where  the  fit  does  not  meet  the  criteria,  the 
average  LCS  for  that  type  of  system  can  be  used  (Hough,  1992:39). 

After  the  data  has  been  deemed  acceptable  for  cumulative  average  theory, 
ordinary  least  squares  (OLS)  regression  can  determine  the  line  passing  through  the  log- 
space  data  points;  providing  the  y-intercept  and  slope  of  the  line.  This  operation  can 
easily  be  done  with  Microsoft  Excel  regression  analysis  and  most  statistical  software 
packages.  The  y-intercept  and  slope  of  the  line  are  the  two  key  data  points  that  must  be 
transformed  back  to  unit  space  (SCEA,  2002:15). 

Transforming  the  y-intercept  back  to  unit  space  provides  the  Tl,  which  is  used  to 
best  fit  the  available  historical  data.  Transformation  is  done  by  exponentiating  the  y- 
intercept  as  shown  in  Equation  5  (SCEA,  2002:16). 

Tl  =  (5) 

e  =  natural  log  base 
ln(a)  =  log-space  y-intercept 


To  arrive  at  the  ECS,  the  percentage  by  which  cost  decreases  as  production  units  double, 
the  value  two  is  raised  to  the  log-space  slope  multiplied  by  the  natural  log  of  two  as 
expressed  in  Equation  6  (SCEA,  2002:16).  How  the  Tl  and  ECS  are  used  in  the 
normalization  process  is  addressed  later  in  this  chapter. 
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LCS  = 


(6) 


e  =  natural  log  base 
b  =  log-space  slope 


F-22  LCS  calculations  in  BY  1996  dollars  in  millions  from  SAR  program  funding 
summary  data  are  shown  in  Table  1 1 . 


Table  11.  F22  LCS  Calculations 


Lot 

Num 

Cum 

Units 

Cum 
PROC 
Base  Yr 
Cost 

CAUC 

Ln 

Cum 

Units 

Ln(CUAC) 

Slope  (b) 

y- 

intercept 

(Ina) 

T1 

Learn 

Curve 

1 

2 

711.10 

355.55 

0.69 

5.87 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

2 

12 

2924.80 

243.73 

2.48 

5.50 

-0.21 

6.02 

411.47 

0.86 

3 

25 

5273.50 

210.94 

3.22 

5.35 

-0.21 

6.02 

410.00 

0.87 

4 

48 

8795.80 

183.25 

3.87 

5.21 

-0.21 

6.02 

410.30 

0.87 

5 

75 

12252.90 

163.37 

4.32 

5.10 

-0.21 

6.02 

413.18 

0.86 

6 

107 

15735.30 

147.06 

4.67 

4.99 

-0.22 

6.04 

418.04 

0.86 

7 

147 

19126.90 

130.11 

4.99 

4.87 

-0.23 

6.06 

426.59 

0.85 

8 

203 

23205.60 

114.31 

5.31 

4.74 

-0.24 

6.08 

438.12 

0.85 

9 

259 

26919.90 

103.94 

5.56 

4.64 

-0.25 

6.11 

449.54 

0.84 

10 

315 

30217.70 

95.93 

5.75 

4.56 

-0.26 

6.13 

460.47 

0.84 

11 

333 

31277.70 

93.93 

5.81 

4.54 

-0.26 

6.15 

468.41 

0.83 

The  ealculations  above  result  in  a  T1  BY  cost  of  $468.41  and  a  learning  curve 
slope  of  0.83.  For  consistency,  the  T1  is  eonverted  to  CY  2000  dollars  in  millions:  CY 
T1  =$556.70. 

The  fifth  step  is  to  compute  the  theoretical  cost  of  the  baseline  quantity  (TCBQ) 
by  applying  the  produetion  learning  curve  and  the  T1  values  as  expressed  by  Equation  7 
(Leonard,  2003).  This  equation  was  adopted  from  previous  RAND  researeh  on  cost 
growth  calculations  and  estimates  the  theoretie  cost  of  the  baseline  program  quantity, 
given  the  eurrent  production  learning  curve. 
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TCBQ  =  BQ  *  T1  *  BQ^(ln(LCS)/ln(2))  (7) 


F-22  TCBQ  calculations  inflated  to  CY  2000  dollars  in  millions  from  2001  SAR: 
65822.16  =  648  *  556.70  *  648^(ln(.83)/ln(2)) 

The  sixth  step  is  to  compute  the  theoretical  cost  of  the  current  quantity  (TCCQ) 
by  applying  the  produetion  learning  curve  and  the  T1  values  as  expressed  by  Equation  8 
(Leonard,  2003).  This  equation  was  adopted  from  previous  RAND  researeh  on  eost 
growth  caleulations  and  estimates  the  theoretic  cost  of  the  current  program  quantity  given 
the  current  production  learning  curve. 

TCCQ  =  CQ  *  T1  *  CQ^(ln(LCS)/ln(2))  (8) 

F-22  TCCQ  calculations  inflated  to  CY  2000  dollars  in  millions  from  2001  SAR; 

40292.03  =  333  *  556.70  *  33^(ln(.83)/ln(2)) 

The  final  step  is  to  identify  the  calculated  quantity-related  eost  varianee 
(CQRCV),  which  represents  the  theoretical  value  of  cost  growth  relative  to  the  baseline 
estimate  at  the  baseline  quantity,  and  is  expressed  by  Equation  9  (Leonard,  2003). 

CQRCV  =  RV  *  TCBQ/TCCQ  (9) 

F-22  CQRCV  calculations  inflated  to  CY  2000  dollars  in  millions  from  2001 

SAR: 
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8698.38  =  5324.60  *  65822.16/40292.03 


Research  Variable 

Once  the  normalization  adjustments  are  made  to  the  data,  the  research  variable, 
adjusted  cost  growth  factor  (ACGF),  can  be  calculated  for  each  SAR  year.  Adjusted  cost 
growth  can  be  represented  in  many  ways:  dollars,  percentage,  or  as  a  factor.  This 
research  focuses  on  adjusted  cost  growth  as  a  factor  of  the  baseline  estimate  and  is 
calculated  by  summing  the  current  RDTE  estimate  (CRDTE),  the  BPROC  plus  the 
CQRCV,  and  the  current  MIECON  (CMIECON)  estimate,  then  dividing  by  the  sum  of 
the  baseline  RDTE  (BRDTE),  BPROC,  and  the  baseline  MIECON  (BMIECON)  as 
shown  in  Equation  10  (Eeonard,  2003). 

ACGE  =  {CRDTE  +  {BPROC  +  CQRCV)  +  CMILCON)/ 

(BRDTE  +  BPROC  +  BMIECON)  (10) 

E-22  ACGE  calculation  inflated  to  CY  2000  dollars  in  millions  from  2001  SAR: 

1.22  =  (27346.34  +  (52270.74  +  8698.38)  +  428.16)/ 

(20464.26  +  52270.74  +  240.27) 

The  ACGE  calculations  are  performed  on  each  SAR  submission  for  all  programs 
in  the  research  sample,  thereby  identifying  annual  ACGEs  as  well  as  total  program 
ACGEs.  An  ACGE  greater  than  1.0  represents  a  program  that  incurred  cost  growth, 
while  an  ACGE  less  than  1 .0  identifies  favorable  cost  performance  within  a  program.  All 
aircraft  weapon  systems  ACGE  calculations  are  shown  in  Appendices  A  to  N. 
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Phase  I  Summary 

This  section  identified  the  Phase  I  research  objective  and  established  the  research 
population,  sample,  and  variable.  A  detailed  description  of  the  methodology  with 
equations  and  examples  for  data  normalization  to  adjust  for  inflation,  quantity  changes, 
and  cost  improvements  over  time  are  provided.  Finally,  an  explanation  for  quantifying 
adjusted  cost  growth  as  a  factor  was  given. 

Phase  II 

Research  Objective 

Chapter  II  identified  DoD  acquisition  reform  attempts  from  1991  to  2001  aimed  at 
streamlining  the  procurement  process  and  reducing  weapon  systems  cost  growth.  A 
GAO  report  to  Congress  measuring  the  success  of  key  Federal  Acquisition  Streamlining 
ACT  (FASA)  initiatives  as  of  the  end  of  fiscal  year  1996,  indicates  “that  the 
organizations  [they]  reviewed  were  working  toward  achieving  key  FASA  purposes,”  and 
“to  reach  meaningful  conclusions  about  the  extent  of  success. .  .additional  data  would 
have  to  be  collected  and  examined  for  subsequent  fiscal  years”  (GAO/NSIAD-98-81;3). 

In  another  report  on  reform  status  in  a  1997  statement  before  the  House  Committee  on 
National  Security,  Under  Secretary  of  Defense  for  Acquisition,  Technology,  and 
Logistics  (USD,  AT&L)  Kaminski  stated:  “DoD  has  achieved  a  large  measure  of  success 
with  acquisition  reform,”  and  the  “Department  has  made  a  number  of  critical  and 
historical  changes  that  are  now  being  institutionalized  and  beginning  to  bear  fruit” 
(Kaminski,  1997).  Additionally,  a  1997  GAO  report  on  the  effect  of  acquisition  reform 
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on  weapon  system  funding  identified  that  $7.20  billion  in  eost  reduetions  from  approved 
budgets  were  expeeted  between  fiseal  year  1995  and  2002  (GAO/NSIAD-98-31;2). 

The  second  objective  of  this  thesis  is  to  analyze  if  current  acquisition  reform 
initiatives  have  indeed  had  any  impact  on  aircraft  weapon  systems  cost  growth.  Thus,  a 
cut-off  treatment  date,  as  well  as  pre-reform  and  post-reform  analysis  windows,  must  be 
identified  for  cost  growth  comparison.  The  broad  and  encompassing  policy  changes  of 
1991  to  2001  naturally  occur  over  time,  and  it  is  “nearly  impossible  to  determine  a 
precise  date  of  implementation  for  the  aggregate  change”  (Searle,  1997:44).  As  a  result, 
consistent  with  the  Holbrook  and  Searle  studies,  this  date  is  judgmentally  selected  as  31 
December  1996  (Holbrook,  2003:35;  Searle,  1997:45).  The  cut-off  treatment  date  for 
this  study  is  chosen  for  the  following  reasons: 

•  GAO  report  that  as  of  the  end  of  fiscal  year  1996  the  DoD  was  in  compliance 
with  FASA  and  that  additional  data  would  need  to  be  collected  and  examined 
for  subsequent  years; 

•  Passage  of  Clinger-Cohen  Act  of  1996; 

•  DoDD  5000  Series  revision  released  in  1997; 

•  Speech  by  USD,  AT&L  Kaminski  regarding  success  to  date  in  1997;  and 

•  GAO  report  estimating  $7.20  billion  reduction  in  budget  from  1995  to  2002 
due  to  the  effects  of  acquisition  reform  on  weapon  system  funding. 

This  cut-off  treatment  date  allows  for  six  years  of  pre-reform  and  five  years  of 
post  reform  SAR  treatment  data  in  the  study,  and  provides  enough  time  to  mitigate  bias 
due  to  factors  such  as  fluctuations  in  the  defense  business  cycle  (Wandland  &  Wickman, 
1993:28).  Therefore,  this  study  will  use  various  statistical  techniques  to  test  aircraft 
weapon  systems  cost  growth  for  the  pre-reform  period  samples  (1  January  1991  to  31 
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December  1996)  to  the  after  re-form  period  samples  (1  January  1997  to  31  December 
2001)  in  order  to  make  inferences  about  the  difference  between  population  cost  growth 
parameters  if  one  exists. 

Population  and  Sample 

The  data  population  for  this  research  encompasses  all  aircraft  weapon  systems 
that  reported  SARs  during  1991  to  2001.  A  pre-reform  and  post-reform  sample  is 
selected  from  this  population  for  Phase  11.  The  pre-reform  sample  includes  only  those 
programs  from  1991  to  1996  that  reported  a  Milestone  11  baseline  estimate.  A  total  of  13 
aircraft  weapon  systems  and  43  SARs  are  included  in  the  pre-reform  sample.  Similarly, 
the  post-reform  sample  includes  only  those  programs  from  1997  to  2001  that  reported  a 
Milestone  II  baseline  estimate.  A  total  of  7  aircraft  weapon  systems  and  35  SARs  are 
included  in  the  post-reform  sample 

Research  Variable 

This  study  analyzes  the  impact  of  acquisition  reform  on  cost  growth  and  utilizes 
the  mean  pre-reform  ACGFs  (mean  ACGFpre-reform)  and  the  mean  post  reform  ACGFs 
(mean  ACGFpost-reform)  as  the  research  variables.  Generating  these  two  research  variables 
requires  two  mathematical  steps.  First  calculate  the  mean  annual  ACGF  as  expressed  by 
Equation  1 1 . 


ACGF,  = 


2acgf, 

V  1 


/  n 


(11) 


i  =  the  ith  ACGF  in  sample  year  j 
n  =  total  number  of  programs  in  year  j 
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Then  calculate  the  mean  ACGF  for  pre-reform  and  post-reform  samples  as  expressed  by 
Equations  12  and  13. 


f  n 


ACGF, 


pre-reform 


Y^ACGFi 

V  1 


/  n 


(12) 


i  =  the  ith  year  in  sample 
n  =  total  number  of  years  in  sample 


ACGF 


post-reform 


Y^ACGF, 

V  1 


/  n 


(13) 


i  =  the  ith  year  in  sample 
n  =  total  number  of  years  in  sample 


The  research  variables  mean  ACGFpre-reform  and  ACGFpost-reform  are  then  analyzed  in  a 
hypothesis  test  to  determine  the  impact  of  acquisition  reform  on  cost  growth. 

Research  Question  and  Hypothesis 

Research  question;  Is  the  mean  ACGF  for  pre-reform  (1  January  1991  to  31 
December  1996)  aircraft  weapon  systems  different  than  the  mean  ACGF  for  post-reform 
(1  January  1997  to  31  December  2001)  aircraft  weapon  systems?  To  answer  this 
question,  the  following  hypothesis  is  tested: 

Hg.  mean  ACGFpre-reform  mean  ACGFpost-reform 

Ha.  mean  ACGFpre-reform  ^  mean  ACGFpost-reform 
If  the  null  hypothesis  is  true,  then  there  is  no  statistical  difference  in  cost  growth  between 
the  pre  and  post  reform  periods.  This  would  indicate  that  current  acquisition  reform 
initiatives  did  not  significantly  impact  cost  growth.  If  the  alternate  hypothesis  is  true. 
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then  there  is  a  statistieal  differenee  between  the  pre  and  post  reform  periods.  This  would 
indieate  that  eurrent  aequisition  reform  initiatives  did  impaet  eost  growth. 

Statistieal  Analysis 

The  prineipal  analysis  used  in  Phase  II  involves  applying  statistieal  tests  to 
determine  whether  signifieant  differenees  exist  between  population  means.  The  first  step 
in  the  analysis  is  to  determine  if  the  required  assumptions  are  met  to  perform  either 
parametrie  or  nonparametrie  teehniques.  Parametrie  statistieal  tests,  like  the  z-test  for 
large  samples  (n  >  30)  and  t-test  for  small  independent  samples  (n  <  30),  involve  making 
inferenees  about  population  parameters  when  the  data  sampled  are  from  a  normally 
distributed  population.  Nonparametrie  tests,  like  the  Wileoxon  rank  sum  test  (a.k.a.  the 
Mann- Whitney  test)  for  making  inferenees  about  two  population  means  and  eommonly 
referred  to  as  distribution-free  tests,  do  not  require  the  data  to  be  normally  distributed 
(MeClave  et  ah,  2001:888). 

If  the  two  population  means  have  samples  where  (n  >  30)  the  z-test  ean  be  used 
sinee  the  Central  Limit  Theorem  states  that  “for  suffieiently  large  samples  the  sampling 
distribution  of  the  sample  mean  is  approximately  normal”  (MeClave  et  ah,  2001:273). 
However,  if  (n  <  30)  for  the  two  population  means  the  small  sample  t-test  must  be  used 
and  an  assessment  of  normality  and  equality  of  varianee  must  be  eondueted  (MeClave  et 
ah,  2001:399).  Sinee  (n  <  30)  for  the  data  in  this  researeh,  tests  to  determine  the 
appropriateness  of  the  small  sample  t-test  will  be  eondueted. 

The  small  sample  t-test  is  the  appropriate  parametrie  statistieal  test  for  eomparing 
two  populations  with  independent  sampling  and  small  sample  sizes  (Sheskin,  2000:247). 
In  order  to  use  the  parametrie  small  sample  t-test,  several  assumptions  must  be  validated: 
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both  sampled  populations  must  be  approximately  normally  distributed  with  equal 
population  variances,  and  the  random  samples  must  be  selected  independently  of  each 
other  (McClave  et  ah,  2001:399).  If  the  assumptions  are  met  and  the  small  sample  t-test 
result  is  significant  we  can  conclude  with  confidence  that  “there  is  a  high  likelihood  that 
the  samples  represent  populations  with  different  means”  (Sheskin,  2000:247). 

If  the  assumption  of  normality  is  violated  for  the  small  sample  t-test,  then  an 
analogous  nonparametric  test  like  the  Wilcoxon  rank  sum  test  can  be  used  (McClave  et 
ah,  2001 :895).  It  can  be  proven  “that  the  Wilcoxon  rank  sum  test  and  the  Mann- Whitney 
U  test  are  equivalent”  (McClave  et  ah,  2001:897),  and  “although  they  employ  different 
equations  and  different  tables,  the  two  versions  of  the  test  yield  comparable  results 
(Sheskin,  2000:289).  There  are  a  number  of  assumptions  necessary  for  the  validity  of  the 
Wilcoxon  ran  sum  test:  the  two  samples  are  random  and  independent,  and  the  two 
probability  distributions  from  which  the  samples  are  drawn  are  continuous  (McClave  et 
ah,  2001 :897).  The  Wilcoxon  rank  sum  test  is  considered  by  many  statisticians  to  be  the 
best  nonparametric  method  used  to  test  the  hypothesis  that  the  probability  distributions 
associated  with  two  populations  are  equivalent  (Gibbons,  1971:149). 

The  hypothesis  testing  applied  in  this  thesis  will  use  an  observed  significance 
level  (alpha  value  [a])  of  .05.  The  appropriate  test  statistic  values  will  be  given,  and  will 
be  explained  using  p-values.  The  p-value  for  a  specific  statistical  test  is  the  “probability 
(assuming  Ho  is  true)  of  observing  a  value  of  the  test  statistic  that  is  at  least  contradictory 
to  the  null  hypothesis”  (McClave  et  ah,  2001:354),  and  is  the  smallest  level  of 
significance  at  which  the  null  hypothesis  would  be  rejected  (Devore,  2000:342).  If  the 
observed  p-value  is  less  than  the  alpha  level  (.05),  reject  the  null  hypothesis;  otherwise  do 
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not  reject  the  null  hypothesis  (McClave  et  al.  2001;  356).  Table  12  displays  the 
acceptance  and  rejection  criteria  for  the  tests  using  p-values. 


Table  12  Hypothesis  Test  Decision  Table  (Holbrook,  2003:44) 

P-value  <  .05  ^  reject  Ho  at  level  .05 

P-value  >  .05  ^  do  not  reject  Hp  at  level  .05 


Data  Preparation 

Prior  to  conducting  hypothesis  testing,  the  parametric  and  nonparametric  test 
assumptions  must  be  compared.  Validation  of  the  small  sample  t-test  requires  that  the 
data  be  assessed  for  independence,  randomness,  normality  and  constant  variance.  If  the 
test  for  normality  or  constant  variance  is  not  met,  the  nonparametric  Wilcoxon  rank  sum 
test  will  be  used.  Assumptions  for  both  the  parametric  small  sample  t-test  and 
nonparametric  Wilcoxon  rank  sum  test  are  displayed  in  Table  13. 


Table  13,  Assumptions 


small  sample  t-test 

Wilcoxon  rank  sum  test 

1.  All  samples  are  random  samples 
from  their  respective  populations. 

1.  All  samples  are  random  samples 
from  their  respective  populations. 

2.  All  samples  are  independently 
selected  from  their  respective 
populations. 

2.  All  samples  are  independently 
selected  from  their  respective 
populations. 

3.  Both  sampled  populations  have 
relative  frequency  distributions  that 
are  approximately  normal. 

3.  The  two  probability  distributions 
from  which  the  samples  are  drawn 
are  continuous. 

4.  The  population  variances  are 
equal. 

Independence 

Independence  of  the  data  was  assumed  based  on  the  following: 
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•  Likeness  eaused  by  legislation  and  regulation  would  affeet  eost  performanee 
equally  aeross  all  DoD  programs;  and 

•  Multiple  programs  under  similar  program  managers  are  run  by  a  multitude  of 
eost  management  eontraetors  and  personnel  (Searle,  1997:58-59). 

The  eharaeteristies  of  the  population  data,  and  subsequent  sample  data  used  in  this  study, 

are  the  same.  All  DoD  aireraft  weapon  systems  are  managed  under  the  same  legislation 

and  regulations,  and  it  is  the  attempt  of  this  researeh  to  determine  if  these  ehanges  have 

impaeted  eost  growth  by  eomparing  pre-reform  and  post-reform  periods.  Additionally, 

within  eaeh  weapon  system  program  there  are  numerous  groups  performing  eost 

management  and  estimating  tasks,  ineluding  support  eontraetors,  finaneial  management 

personnel,  and  engineers,  all  with  varying  degrees  of  experienee  and  training.  Therefore, 

the  assumption  of  independenee  ean  be  established.  Despite  all  of  the  variables  that 

support  the  assumption  of  independenee  in  this  data,  it  is  important  to  aeknowledge  the 

possibility  that  the  samples  may  not  be  independent;  thereby,  potentially  skewing  the 

analysis  results. 

Random  sample 

A  random  sample  is  defined  as  one  whieh  “ensures  that  every  subset  of  fixed  size 
in  the  population  has  the  same  ehanee  of  being  ineluded  in  the  sample”  (MeClave  et  ah, 
2001:16).  Sinee  this  researeh  eontains  the  entire  population  of  aireraft  systems  in  the 
SAR  database  from  1991  to  2001,  the  extraeted  data  eannot  be  truly  random.  However, 
given  the  statistieal  limitations  of  working  with  “real”  data  and  the  eomplete  utilization  of 
existing  population  data,  the  random  sample  requirement  is  assumed.  It  is  important  to 
note  that  failure  to  meet  the  random  sample  requirement  may  skew  analysis  results. 
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Normality 

The  normality  requirement  will  be  tested  both  subjeetively  and  objeetively.  The 
subjeetive  analysis  eonsists  of  generating  normal  probability  plots,  whieh  provide  a 
graphieal  display  of  the  data.  A  straight  line  would  indieate  the  potential  existenee  of  a 
normal  distribution,  while  a  nonlinear  eonfiguration  would  indieate  the  eontrary 
(D’Agosto  and  Stephens,  1986:35).  This  graphieal  representation  serves  only  as  an 
informal  preliminary  judgment  of  normality  and  should  always  be  aeeompanied  by  a 
formal  normality  test  (D’Agosto  and  Stephens,  1986:41,  405). 

The  Shapiro-Wilks  test  for  normality  eonstitutes  the  formal  objeetive  test  and  is 
preferred  over  less  aeeurate  tests  sueh  as  the  ehi  square  and  Kolmogorov-Smimov  tests. 
Overall,  the  Shapiro-Wilks  test  is  probably  the  most  powerful  non-graphieal  test  of 
normality  (D’Agosto  and  Stephens,  1986:41,  406).  The  null  hypothesis  for  the  Shapiro 
Wilks  test  is  that  the  data  is  normally  distributed,  while  the  alternate  hypothesis  is  that  the 
data  is  not  normally  distributed  (D’Agosto  and  Stephens,  1986:41,  368).  The  resulting  p- 
value  from  this  test  indieates  the  signilieanee  of  any  normality  violations  and  is  identified 
by  a  p-value  that  is  less  than  or  equal  to  the  established  alpha  level. 

Equality  of  Varianee 

The  method  for  testing  homogeneity  of  varianee  is  dependent  on  the  normality  of 
the  populations  being  analyzed;  assuming  independenee  and  random  sample 
requirements  are  met.  If  the  populations  are  both  normally  distributed  then  the  F-Test  for 
equal  population  varianees  would  be  employed.  The  F-Test  uses  the  ratio  of  population 
varianees  as  the  test  statistie  to  assess  if  there  is  equal  varianee  between  the  populations 
(MeClave  et  ah,  2001:435-436).  If  the  F-Test  reveals  equality  of  varianee  and  all  other 
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assumptions  are  met,  the  parametric  small  sample  t-test  using  a  pooled  sample  estimator 
of  the  variance  can  be  used. 

If  a  population’s  Shapiro  Wilks  test  revels  that  the  data  is  non-normally 
distributed,  which  past  cost  growth  research  has  indicated  (Christensen  and  Templin, 
2002:108),  then  the  Levene  Test  for  homogeneity  of  variance  will  be  used  because  it  is 
less  sensitive  to  violations  of  normality  (Neter  et  ah,  1996:1 12).  While  the  assumption  of 
equality  of  variance  is  not  required  when  performing  the  nonparametric  Wilcoxon  rank 
sum  test,  the  results  of  the  Levene  Test  for  homogeneity  of  variance  can  provide  a 
general  description  about  the  data’s  consistency. 

Phase  II  Summary 

This  section  identified  the  Phase  II  research  objective  and  detailed  the 
methodology  utilized  to  determine  if  acquisition  reform  initiatives  have  made  an  impact 
on  aircraft  weapon  system  cost  growth.  The  hypothesis  testing  treatment  methods  were 
defined,  and  the  assumptions  necessary  for  appropriate  model  selection,  either  the 
parametric  two  sample  t-test  or  nonparametric  Wilcoxon  rank  sum  test,  was  discussed. 

Chapter  Summary 

This  chapter  detailed  the  methodology  utilized  to  conduct  each  phase  of  the 
analysis.  Phase  I  focused  on  generating  ACGFs  for  each  aircraft  weapon  system  for  all 
relevant  years  in  the  research  window.  Subsequently,  Phase  II  utilized  the  ACGFs  from 
Phase  I  to  test  if  current  acquisition  reform  initiatives  have  made  any  impact  on  aircraft 
weapon  system’s  cost  growth.  Results  of  these  analyses  are  provided  in  Chapter  IV. 
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IV.  Results 


Chapter  Overview 

This  chapter  presents  the  results  of  the  statistieal  analysis  for  eaeh  phase  of  the 
researeh.  An  analytieal  summary  of  the  statistieal  test  results  are  presented  as  either 
tabular  or  graphical  images  for  each  individual  phase. 


Phase  I 

The  purpose  of  Phase  I  was  to  calculate  adjusted  aircraft  weapon  system  eost 
growth  faetors  from  the  1991  to  2001  Seleeted  Aequisition  Reports  (SAR),  using  a  hybrid 
adjusted  cost  growth  model.  The  data  population  for  this  research  contains  of  all  aircraft 
weapon  system  programs  that  reported  SARs  during  1991  to  2001.  The  samples  seleeted 
for  Phase  I  includes  only  those  programs  with  a  reported  Milestone  II  baseline.  A  total  of 
13  aireraft  weapon  systems,  with  78  reported  SARs,  were  identified  for  this  treatment 
period,  and  the  adjusted  eost  growth  faetors  (ACGF)  are  presented  in  Table  14. 


Table  14,  Annual  Adjusted  Cost  Growth  Factors 


Program 

1991 

1992 

1993 

1994 

1995 

1996 

1997 

1998 

1999 

2000 

2001 

B1-B  (Lancer) 

1.00 

1.03 

C130-J  (Hercules) 

1.31 

1.29 

1.38 

1.38 

C-17  (Globemaster  III) 

1.43 

1.61 

2.52 

2.26 

2.23 

2.26 

2.21 

2.22 

2.22 

1.96 

KC-135R  (Stratotanker) 

0.81 

0.82 

0.82 

AV-8B  (Harrier) 

0.91 

0.92 

AV-8B  (Harrier  Remanufacture) 

1.08 

1.03 

1.00 

1.03 

1.04 

1.03 

1.03 

F-14D  (Tomcat) 

1.27 

1.27 

1.26 

F-16  (Fighting  Falcon) 

1.98 

1.95 

1.98 

2.02 

F-22  (Raptor) 

0.99 

1.00 

1.00 

1.04 

1.03 

1.06 

1.07 

1.08 

1.08 

1.22 

FA-18  E/F  (Super  Hornet) 

1.00 

1.01 

1.02 

0.97 

0.95 

0.48 

0.48 

0.73 

0.77 

FA-18  (Hornet) 

1.52 

1.56 

1.57 

1.56 

T-6A  (JPATS) 

0.99 

0.97 

0.97 

0.97 

0.97 

T-45-TS  (Goshawk) 

1.57 

1.59 

1.73 

2.26 

2.25 

2.25 

2.16 

2.05 

2.33 

2.33 

Average  Annual  ACGF 

1.31 

1.30 

1.48 

1.59 

1.53 

1.42 

1.39 

1.30 

1.36 

1.39 

1.30 
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The  sampling  distribution  of  the  data  set  in  Table  14  is  eomprised  of  the  78  aireraft 
weapon  systems  ACGFs,  whieh  ereate  the  population  distributions  for  the  eleven  annual 
means,  and  henee  the  random  variable  under  study  in  Phase  II. 

One  of  the  researeh  objeetives  of  this  thesis  was  to  eompare  the  1993  RAND  eost 
growth  analysis  results  for  aireraft  weapon  systems,  whieh  averaged  28  pereent  and 
eovered  the  late  1960s  to  1990,  to  that  of  aireraft  weapon  systems  for  the  eurrent  researeh 
treatment  period  of  1991  to  2001.  Averaging  all  eurrent  aireraft  weapon  system  adjusted 
eost  growth  faetors  (ACGF)  produeed  an  overall  average  for  the  treatment  period  of  40 
pereent;  whieh  is  12  pereentage  points  higher  than  the  historieal  RAND  results  of  28 
pereent. 

Phase  II 

The  objeetive  of  Phase  II  was  to  determine  if  eurrent  aequisition  reform  initiatives 
have  impaeted  the  mean  annual  ACGFs  for  aireraft  weapon  systems.  The  mean  annual 
ACGF  for  eaeh  year  is  depleted  in  Figure  4. 
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Average  Annual  Aircraft  System  ACGFs 


Figure  4,  Average  Annual  Aircraft  Adjusted  Cost  Growth  Factors 

The  objected  in  Phase  II  was  accomplished  by  performing  a  hypothesis  test 
between  the  ACGFs  of  the  pre-reform  period  (I  January  to  31  December  1996)  to  the 
mean  ACGFs  of  the  post-reform  period  (I  January  1997  to  31  December  2001).  Table  15 
provides  statistics  on  the  aircraft  weapon  systems  available  from  SARs  during  the 
treatment  periods  that  meet  all  requirements  listed  for  this  research. 


Table  15,  Study  Sample  Statistics 


Group 

Pre-Reform 

Post-Reform 

#  Programs 

(1  Jan  91  -31  Dec  96) 
11 

(1  Jan  97-31  Dec  01) 

7 

#SARs 

43 

35 

Sample  Means 

1.44 

1.35 

Sample  Std  Dev 

0.12 

0.05 
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The  post-reform  ACGF  mean  of  1.35  is  less  than  the  pre-reform  ACGF  mean  of 
1 .44.  However,  to  make  a  eorreet  inferenee  as  to  whether  a  signifieant  differenee  exists 
between  the  two  periods  a  statistieal  hypothesis  test  must  be  eondueted.  Before  a 
hypothesis  test  ean  be  administered,  it  must  be  determined  whether  to  use  a  parametrie  or 
nonparametrie  statistieal  test.  In  order  to  aeeurately  assess  whether  a  parametrie  or 
nonparametrie  hypothesis  test  is  appropriate,  the  assumptions  of  normality  and  equality 
of  varianee  are  tested  using  a  statistieal  software  paekage,  IMP  5.1.  The  assumption  test 
outputs  and  eorresponding  p-values  are  provided.  The  assumptions  of  independenee  and 
randomness  were  assumed  as  stated  in  Chapter  111,  therefore  no  formal  tests  are 
eondueted. 

Normality 

Normality  of  the  six  pre-reform  means  and  five  post-reform  means  was  tested 
both  subjeetively  and  objeetively.  The  subjeetive  test  eonsisted  of  generating  normal 
probability  plots  for  both  the  pre-reform  and  post-reform  samples  as  shown  in  Figure  5. 
Sinee  the  data  points  from  eaeh  sample  period  form  a  relatively  straight  line,  it  is  likely 
that  the  samples  are  normal.  This  is  to  be  expeeted  sinee  the  sampling  distribution  of  43 
pre-reform  and  35  post-reform  ACGFs  are  large  enough  to  approximate  a  normal 
distribution  of  the  pre-reform  and  post  reform  sample  means. 
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Pre-Reform  Normality 


Post-Reform  Normality 


Normal  Quantile  Plot  Normal  Quantile  Plot 


Figure  5,  JMP  5,1  Normality  Plots 

The  objective  test  consisted  of  using  the  Shapiro-Wilks  Test  for  Normality  and 
the  test  results  are  displayed  in  figure  6. 

Pre-Reform  Normality  Post-Reform  Normality 


0.926350  0.5541  0.823938  0.1231 

Figure  6.  JMP  5,1  Shapiro  Wilks  Test  Results 

The  p-value  in  the  pre-reform  sample  of  .5541  and  post-reform  sample  of  .1231 
are  clearly  greater  than  the  established  alpha  level  of  0.05,  which  indicates  that  both 
samples  originate  from  a  normal  distribution.  Since  the  parametric  small  sample  t-test 
assumption  of  normality  is  validated,  the  F-Test  for  equal  population  variances  is 
employed  to  check  the  equality  of  variance  assumption. 


Goodness-of-Fit  Test 

Shapiro-Wilk  W  Test 

W  Prob^ 


Goodness-of-Fit  Test 

Shapiro-Wilk  W  Test 

W  Prob^ 
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Equality  of  Variance 

The  F-test  for  equal  population  varianees  ean  be  eondueted  on  the  sample  data  set 
since  the  assumptions  that  the  two  populations  are  normally  distributed  and  randomly  and 
independently  selected  from  their  populations,  have  been  satisfied  (McClave  et  ah, 
2001:436).  The  F-test  compares  the  population  variances  by  making  inferences  about  the 
ratio  of  the  sample  variance.  An  F-test  for  equality  of  variance  was  conducted  using  JMP 
5.1.  The  F-test  results  are  displayed  in  Figure  7. 

Tests  that  the  Variances  are  Equal 

Level  Count  Sid  Dev  MeanAbsDif  to  Mean  MeanAbsDif  to  Median 

1  6  0.1168254  0.0948110  0.0948110 

2  5  0.0449653  0.0376182  0.0418799 

Test  F  Ratio  DFNum  DFDen  Prob  >  F 

F  Test  2-sided  6.7503  5  4  0.0880 

Figure  7,  JMP  5,1  F-Test  Results 

Since  the  F-test  two  sided  p-value  of  .0880  is  greater  than  the  established  alpha 
level  of  0.05,  the  equality  of  variance  assumption  is  satisfied  and  the  data  appears 
stationary.  The  parametric  small  sample  t-test,  with  a  pooled  sample  estimator  of  the 
variance,  can  now  be  conducted  to  compare  the  pre-reform  and  post-reform  means. 

Hypothesis  Test  Results 

The  small  sample  t-test  is  an  inferential  statistical  test  employed  to  evaluate 
whether  the  two  independent  samples  represent  two  populations  with  different  mean 
values  (Sheskin,  2000:247).  The  small  sample  t-test  used  in  this  research  to  determine  if 
pre-reform  and  post-reform  ACGF  means  are  the  equivalent,  is  a  non-directional  two- 
tailed  test.  If  the  test  results  are  significant,  one  can  conclude  that  there  is  a  high 
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likelihood  that  the  two  sample  means  are  different.  The  small  sample  t-test  JMP  5.1 
results  are  displayed  in  Figure  8. 


t  Test 


1-2 


Assuming  unequal  variances 
Difference  0.09283  t  Ratio  1 .793509 

StdErrDif  0.05176  DF  6.672153 

Upper  CL  Dif  0.21645  Prob  >  |t|  0.1181 

Lower  CL  Dif  -0.03079  Prob  >  t  0.0590 

Confidence  0.95  Prob  <  t  0.9410 


Figure  8,  JMP  5,1  Small  Sample  T-Test  Results 

Since  the  t-test  p-value  of  0.1 181  is  greater  than  the  established  alpha  of  0.05, 
there  is  insufficient  evidence  to  reject  the  null  hypothesis.  Therefore,  the  t-test  results 
provide  statistical  support  that  the  pre-reform  and  post-reform  samples  represent  two 
populations  with  equal  annual  ACGF  means.  Further  analysis  of  the  JMP  5.1  small 
sample  t-test  output  reveals  a  95  percent  confidence  interval  that  the  true  difference 
between  the  population  means  falls  within  the  lower  bound  range  of  -.03079  and  upper 
bound  range  of  .21645.  Since  this  range  includes  zero,  there  is  a  95  percent  probability 
that  the  two  populations  actually  have  the  same  mean. 


Chapter  Summary 

This  chapter  presented  the  results  of  the  statistical  analysis  for  each  phase  of  the 
research.  Initially,  the  Phase  I  annual  ACGFs  for  each  aircraft  weapon  system  were 
identified  for  years  1991  to  2001.  The  treatment  period  aircraft  weapon  system  ACGF 
average  of  40  percent  was  calculated  and  shown  to  be  12  percentage  points  higher  than 
the  30  year  historical  average  of  28  percent  reported  by  RAND. 
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Next,  a  Phase  II  hypothesis  test  was  ehosen  to  determine  if  the  mean  ACGF  for 
pre-reform  (I  January  1991  to  31  Deeember  1996)  aireraft  weapon  systems  was  equal  to 
the  mean  ACGF  for  post-reform  (I  January  1997  to  31  December  2001)  aircraft  weapon 
systems.  The  parametric  small  sample  t-test  was  chosen  as  the  hypothesis  test  after  the 
Shapiro-Wilks  test  for  normality  indicated  that  the  sample  distributions  were  normal  and 
the  F-test  revealed  equality  of  variance.  Finally,  the  Phase  II  small  sample  t-test 
hypothesis  results  were  presented,  identifying  no  significant  statistical  disparity  between 
the  means  of  each  reform  period. 
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V.  Conclusion 


Review  of  Research  Objectives 

This  research  focused  on  two  main  objectives.  First,  using  a  hybrid  adjusted  cost 
growth  model  determine  if  aircraft  weapon  systems  incurred  cost  growth  from  1991  to 
2001  at  a  similar  rate  to  aircraft  weapon  systems  cost  growth  identified  in  the  previous  30 
years  by  RAND.  Second,  by  means  of  hypothesis  testing,  identify  if  any  significant 
statistical  indications  reveal  if  acquisition  reform  initiatives  implemented  during  the 
research  window  made  any  impact  on  aircraft  weapon  systems  cost  growth. 

Discussion  of  Results 

The  Phase  1  adjusted  cost  growth  factor  (ACGF)  results  revealed  that  from  1991 
to  2001  aircraft  weapon  systems  have  on  average  exceeded  the  28  percent  historical 
ACGF  identified  by  RAND.  This  result  is  apparent  when  comparing  the  mean  annual 
ACGF  for  the  entire  treatment  period  of  40  percent  from  Table  14  to  the  28  percent 
historical  ACGF  previously  calculated  by  RAND.  Additionally,  the  results  identified  that 
9  of  the  13  (69.23  percent)  aircraft  weapon  systems  included  in  this  analysis  experienced 
cost  growth  from  1991  to  2001. 

The  Phase  11  statistical  assumptions  of  independence,  random  sampling, 
normality,  and  equality  of  variance  were  validated  to  determine  the  appropriate 
hypothesis  test  for  this  analysis.  While  independence  and  random  sampling  were 
assumed,  the  normality  and  equality  of  variance  assumptions  passed  the  appropriate  test, 
identifying  the  need  for  a  parametric  hypothesis  test.  The  small  sample  t-test  was  chosen 
for  this  analysis  because  it  is  the  most  appropriate  statistical  test  for  comparing  two 
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populations  with  independent  sampling  and  small  sample  sizes.  The  small  sample  t-test 
results  provide  statistieal  support,  in  general,  to  aeeept  the  null  hypothesis  that  the  pre¬ 
reform  sample  and  the  post-reform  sample  represent  two  populations  with  equal  annual 
ACGF  means.  Therefore,  at  the  alpha  level  of  .05,  we  ean  be  95  pereent  eonfident  that 
the  average  annual  ACGF  in  the  pre-reform  and  post-reform  periods  are  the  same. 

Conclusions 

The  Phase  I  results  identified  that  from  1991  to  2001  over  69  pereent  of  aireraft 
weapon  systems  experieneed  adjusted  eost  growth,  with  an  overall  average  of  40  pereent; 
well  above  the  historieal  average  of  28  pereent  previously  reported  by  RAND.  These 
results  effeetively  satisfied  the  initial  researeh  objeetive  of  determining  if  adjusted  eost 
growth  existed  in  aireraft  weapon  systems  during  the  researeh  period  and  developed  the 
ACGFs  for  the  Phase  II  analysis.  The  Phase  I  analysis  revealed  several  eomplieating 
faetors  involved  in  performing  eost  growth  ealeulations.  Initially,  the  data  ineluded  in 
eost  growth  ealeulations  are  somewhat  subjeetive,  as  one  must  earefully  interpret  the 
Seleeted  Aequisition  Report’s  (SAR)  qualitative  and  quantitative  seetions.  Proper  data 
extraetion  from  the  SAR  is  perhaps  best  elassified  as  an  art  rather  than  a  seienee,  as 
numerous  organizations  have  developed  different  eost  data  from  the  same  souree 
doeuments.  Furthermore,  there  are  several  different  methodologies  available  to  ealeulate 
eost  growth.  Researehers  must  elearly  determine  how  to  adjust  for  inflation  and  whether 
or  not  to  aeeount  for  quantity  adjustments,  produetion  learning  eurves  or  simply  eompute 
the  raw  data  at  faee  value.  Seleeting  the  appropriate  methodology  for  the  researeh 
objeetive  is  erueial  in  generating  aeeurate  results.  Finally,  the  dynamie  nature  of  using 
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“real  world”  data  poses  several  statistieal  limitations  as  new  aireraft  weapon  systems 
begin  and  existing  systems  terminate  throughout  the  researeh  period.  However,  statistieal 
limitations  are  eommon  and  generally  aeeepted  when  dealing  with  “real  world”  data. 

The  results  of  Phase  II  raise  some  eoneems  about  the  effeetiveness  of  eurrent 
aequisition  reform  strategies  on  weapon  system  eost  growth.  As  revealed  in  Chapter  II, 
many  of  the  same  reform  initiatives  re-appear  with  eaeh  attempt  by  the  Department  of 
Defense  (DoD),  Congress,  and  Presidential  Administration  to  eurb  eost  growth,  even 
after  historieal  eost  growth  studies  revealed  that  eost  growth  within  major  defense 
aequisition  programs  (MDAP)  eontinue  to  average  around  20  pereent.  Many  of  the 
themes  that  have  persisted  in  both  historieal  and  eurrent  aequisition  reform  endeavors 
inelude;  a  push  to  eliminate  bureaueraey,  streamlining  regulatory  guidelines, 
implementing  eommereial  praetiees,  providing  the  end-user  more  flexibility,  and 
organizational  eulture  ehange.  While  the  majority  of  the  DoD,  Congressional,  and 
Presidential  Administration’s  aequisition  reform  efforts  have  targeted  some  form  of 
management  ineffleieneies,  the  results  of  this  and  previous  eost  growth  studies  eertainly 
leaves  room  for  debate  as  to  whether  this  approaeh  is  appropriate  for  redueing  eost 
growth. 

Recommendations  for  Future  Research 

During  the  eourse  of  this  thesis,  three  potential  areas  for  follow-on  researeh  arose. 
First,  analyze  reeent  eost  growth  for  all  weapon  systems  using  SAR  data.  Results  from 
this  analysis  eould  be  eompared  with  RAND’s  historieal  eost  growth  results  to  determine 
if,  on  a  maero  level,  any  improvements  have  oeeurred  over  time.  Additionally,  testing  for 
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differences  in  the  pre-reform  and  post-reform  population  means  of  all  weapon  systems 
may  reveal  that  the  aircraft  weapon  system  results  in  this  thesis  were  simply  an  anomaly 
and  acquisition  reform  initiatives  have  made  cost  growth  improvements.  Second, 
identify  the  causes  of  cost  growth  at  the  program  level  and  quantify  the  most  severe  cost 
growth  drivers.  Due  to  the  dynamic  nature  of  weapon  system  acquisition,  identifying 
cost  drivers  that  universally  apply  to  all  programs  may  not  provide  a  specific  program 
manager  with  much  insight.  However,  research  performed  to  identify  and  quantitatively 
rank  the  most  significant  program  specific  cost  drivers  would  reveal  where  the  greatest 
cost  growth  mitigation  efforts  should  be  focused.  Finally,  develop  a  program  specific 
cost  growth  model  to  facilitate  cost  growth  management  in  the  future.  Numerous 
researchers  have  designed  generic  cost  growth  prediction  models  applicable  to  all 
weapon  systems;  however,  designing  a  cost  growth  prediction  model  for  a  specific 
program  may  provide  more  relevant  results  for  the  respective  program  manager.  A  more 
specialized  cost  growth  model  for  a  single  weapon  system  should  effectively  account  for 
the  nuances  of  that  system  and  generate  a  more  accurate  cost  growth  forecast.  This 
improvement  in  cost  growth  forecasting  accuracy  would  enable  a  program  manager  to 
devise  a  more  appropriate  scheme  for  mitigating  cost  growth. 
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Appendix  A,  Bl-B  (Lancer)  ACGF  Calculations 


1 

1  BY  1981  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PROC 

Mil -CON 

Total 

RDTE 

PRQC 

Mil -CON 

Total 

1982 

100 

2582.60 

17862.30 

0.00 

20444.90 

4391.43 

30218.74 

0.00 

34610.17 

1 

1  BY  1981  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

YEAR 

Dollars 

RDTE 

PROC 

Mil -CON 

Total 

RDTE 

PRQC 

Mil -CON 

Total 

1991 

1981 

3019.80 

17396.10 

0.00 

20415.90 

5134.84 

29430.05 

0.00 

34564.89 

1992 

1981 

3337.40 

17617.10 

0.00 

20954.50 

5674.89 

29803.92 

0.00 

35478.81 

1 

1  BY  1981  Dollars  In  Millions  Qty  Adjnstment  Data  | 

Cnrrent 

Primary 

Seeondary 

Cnm  Total 

SAR 

BY 

PROC 

BY  Qty 

BY  Qty 

Total  BY 

BY  Qty 

Total  BY 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

PRQC  Var 

BY  Var 

1991 

1981 

100 

0.00 

0.00 

0.00 

-3.70 

-466.20 

-462.50 

- 

1992 

1981 

100 

0.00 

0.00 

0.00 

-3.70 

-245.20 

-241.50 

- 

1 

1  CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data  | 

Cnrrent 

Primary 

Seeondary 

Cnm  Total 

SAR 

BY 

PROC 

CY  Qty 

CY  Qty 

Total  CY 

CYQty 

Total  CY 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

PRQC  Var 

CY  Var 

1991 

1981 

100 

0.00 

0.00 

0.00 

-6.26 

-788.70 

-782.44 

- 

1992 

1981 

100 

0.00 

0.00 

0.00 

-6.26 

-414.82 

-408.56 

- 

1 

1  Leaning  Cnrve  Analysis  Applied  To  Qty  Varianees  | 

1  1 

SAR 

BY 

BY  T1 

Learn 

CYTl 

CY 

CY 

CY 

- 

- 

1991 

1981 

1383.63 

2340.77 

32956.42 

32956.42 

-782.44 

- 

- 

1992 

1981 

1383.63 

2340.77 

32956.42 

32956.42 

-408.56 

- 

- 

1  Adjnsted  CGFs 

1  Unadjnsted  CGFs  | 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PRQC 

Mil -CON 

Program 

- 

YEAR 

ACGF 

ACGF 

UN-ACGF 

UN-ACGF 

UN-ACGF 

UN-ACGF 

1991 

- 

0.97 

- 

1.17 

0.97 

#DlV/0! 

■LB 

- 

1992 

- 

0.99 

■BB 

- 

1.29 

0.99 

#DlV/0! 

- 
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Appendix  B,  C-130J  (Hercules)  ACGF  Calculations 


SAR 

YEAR 


1997 

1998 

1999 

2000 
2001 


MSII 

Baseline 

Qty 


BY  1996  Dollars  In  Millions 


CY  2000  Dollars  In  Millions 


MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

RDTE 

PROC 

MIT  CON 

Total 

RDTE 

PRQC 

MIT  CON 

Total 

8.90 

514.10 

0.00 

523.00 

9.41 

542.07 

0.00 

551.48 

BY  1996  Dollars  In  Millions 

CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

RDTE 

PROC 

MIT  CON 

Total 

RDTE 

PRQC 

MIT  CON 

Total 

9.40 

1100.90 

0.00 

1110.30 

9.94 

1160.80 

0.00 

1170.74 

9.40 

2615.40 

0.00 

2624.80 

9.94 

2757.70 

0.00 

2767.64 

9.40 

2394.80 

0.00 

2404.20 

9.94 

2525.09 

0.00 

2535.03 

9.40 

2394.80 

0.00 

2404.20 

9.94 

2525.09 

0.00 

2535.03 

9.40 

12612.20 

0.00 

12621.60 

9.94 

13298.40 

0.00 

13308.34 

BY  1996  Dollars  In  Millions  Qty  Adjnstment  Data 


Current  Primary  Secondary 


Cnm  Total  Total  BY 


PROC  BY  Qty  BY  Qty  Total  BY  BY  Qty  PROC 


Var 


522.80 

1017.10 
-270.80 

0.00 

9414.10 


Qty  Var 


522.80 

1002.40 

-305.70 

0.00 


Var 


161.90 

1164.30 

858.60 

858.60 


Var 


586.80 

2101.30 

1880.70 

1880.70 


808.50  10222.60  11081.20  12098.10 


Residnal 
BY  Var 


424.90 
937.00 
1022.10 
1022.10 

1016.90 


CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 


Current  Primary  Secondary 


Cnm  Total  Total  CY 


PROC  CY  Qty  CY  Qty  Total  CY  CY  Qty  PROC 


Var 


551.24 

1072.44 

-285.53 

0.00 

9926.30 


Qty  Var 


551.24 

1056.94 

-322.33 

0.00 


Var 


170.71 

1227.65 

905.31 

905.31 


Var 


618.73 

2215.63 

1983.02 

1983.02 


852.49  10778.79  11684.10  12756.33 


Residnal 
CY  Var 


448.02 

987.98 

1077.71 

1077.71 

1072.23 


BY 

Dollars 


996 

996 

996 

996 

996 


1  Leaning  Cnrve  Analysis  Applied  To  Qty  Variances  | 

BYTl 

Learn 

Curve 

CY  T1 

CY 

Theoretic 

Baseline 

CY 

Theoretic 

Current 

CY 

Calcnlated 
Qty  Var 

32.59 

1.14 

34.37 

404.40 

1057.67 

171.30 

32.59 

1.14 

34.37 

404.40 

2485.13 

160.77 

32.59 

1.14 

34.37 

404.40 

2092.17 

208.31 

32.59 

1.14 

34.37 

404.40 

2092.17 

208.31 

32.59 

1.14 

34.37 

404.40 

14941.56 

29.02 

Adjnsted  CGFs 


Total 


PROC 

ACGF 


Program 

ACGF 


.32  ] 

1.31 

.30  ] 

1.29 

.38  ] 

1.38 

.38  ] 

1.38 

.05  ] 

1.05 

Unadjnsted  CGFs 


Total 

RDTE  PROC  MILCON  Program 
UN-ACGF  UN-ACGF  UN-ACGF  UN-ACGF 
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Appendix  C,  C-17  (Globemaster  III)  ACGF  Calculations 


BY  1981  Dollars  In  Millions 


CY  2000  Dollars  In  Millions 


MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PROC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

1985 

210 

2879.80 

16684.20 

112.50 

19676.50 

4896.79 

28225.68 

186.04 

33308.51 

1  BY  1981  &  1996 

Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Current 

Current 

Current 

Current 

Current 

Current 

Current 

Current 

YEAR 

Dollars 

RDTE 

PROC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

1991 

1981 

3913.30 

15084.00 

265.20 

19262.50 

6654.14 

25518.52 

438.56 

32611.23 

1992 

1981 

3925.50 

17295.50 

192.50 

21413.50 

6674.89 

29259.85 

318.34 

36253.08 

1993 

1981 

4070.40 

8276.30 

169.20 

12515.90 

6921.27 

14001.52 

279.81 

21202.60 

1994 

1981 

4071.40 

8305.40 

140.20 

12517.00 

6922.97 

14050.75 

231.85 

21205.58 

1995 

1996 

7617.10 

32448.20 

328.10 

40393.40 

8053.61 

34213.62 

347.42 

42614.64 

1996 

1996 

7620.90 

32149.40 

354.10 

40124.40 

8057.62 

33898.57 

374.95 

42331.14 

1997 

1996 

7619.90 

32511.20 

352.30 

40483.40 

8056.57 

34280.05 

373.04 

42709.66 

1998 

1996 

7763.40 

35992.70 

357.90 

44114.00 

8208.29 

37950.97 

378.97 

46538.23 

1999 

1996 

7840.60 

36055.20 

364.10 

44259.90 

8289.91 

38016.87 

385.54 

46692.32 

2000 

1996 

7840.60 

36055.20 

364.10 

44259.90 

8289.91 

38016.87 

385.54 

46692.32 

2001 

1996 

8233.80 

47167.40 

750.70 

56151.90 

8705.65 

49733.66 

794.90 

59234.20 

BY  1981  &  1996  Dollars  In  Millions  Qty  Adjustment  Data 


SAR 

YEAR 

BY 

Dollars 

Current 

PROC 

Qty 

Primary 
BY  Qty 
Var 

Secondary 
BY  Qty 
Var 

Total  BY 
Qty  Var 

Cum  Total 
BY  Qty 
Var 

Total  BY 

PROC 

Var 

Residual 

BY  Var 

1991 

1981 

120 

0.00 

0.00 

0.00 

-6037.00 

-1600.20 

4436.80 

1992 

1981 

120 

0.00 

0.00 

0.00 

-6037.00 

611.30 

6648.30 

1993 

1981 

40 

-5576.80 

-3617.40 

-9194.20 

-15231.20 

-8407.90 

6823.30 

1994 

1981 

40 

0.00 

268.20 

268.20 

-14963.00 

-8378.80 

6584.20 

1995 

1996 

120 

10415.50 

6273.60 

16689.10 

1726.10 

15764.00 

14037.90 

1996 

1996 

120 

0.00 

0.00 

0.00 

1726.10 

15465.20 

13739.10 

1997 

1996 

120 

0.00 

0.00 

0.00 

1726.10 

15827.00 

14100.90 

1998 

1996 

134 

1567.60 

1265.90 

2833.50 

4559.60 

19308.50 

14748.90 

1999 

1996 

134 

0.00 

0.00 

0.00 

4559.60 

19371.00 

14811.40 

2000 

1996 

134 

0.00 

0.00 

0.00 

4559.60 

19371.00 

14811.40 

2001 

1996 

180 

4848.20 

6849.70 

11697.90 

16257.50 

30483.20 

14225.70 

1  CY  2000  Dollars  In  Millions  Qty  Adjustment  Data 

Current 

Primary 

Secondary 

Cum  Total 

Total  CY 

SAR 

BY 

PROC 

CY  Qty 

CY  Qty 

Total  CY 

CY  Qty 

PROC 

Residual 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

CY  Var 

1991 

1981 

120 

0.00 

0.00 

0.00 

-10213.16 

-2707.16 

7506.01 

1992 

1981 

120 

0.00 

0.00 

0.00 

-10213.16 

1034.17 

11247.34 

1993 

1981 

40 

-9434.61 

-6119.78 

-15554.39 

-25767.55 

-14224.16 

11543.39 

1994 

1981 

40 

0.00 

453.73 

453.73 

-25313.82 

-14174.93 

11138.89 

1995 

1996 

120 

17620.54 

10613.43 

28233.97 

2920.15 

26668.92 

23748.77 

1996 

1996 

120 

0.00 

0.00 

0.00 

2920.15 

26163.42 

23243.28 

1997 

1996 

120 

0.00 

0.00 

0.00 

2920.15 

26775.50 

23855.35 

1998 

1996 

134 

2652.00 

2141.60 

4793.61 

7713.75 

32665.37 

24951.62 

1999 

1996 

134 

0.00 

0.00 

0.00 

7713.75 

32771.10 

25057.35 

2000 

1996 

134 

0.00 

0.00 

0.00 

7713.75 

32771.10 

25057.35 

2001 

1996 

180 

8202.00 

11588.06 

19790.05 

27503.81 

51570.29 

24066.49 
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1  1 

1  Leaning  Curve  Analysis  Applied  To  Qty  Variances  | 

1  1 

CY 

CY 

CY 

SAR 

BY 

Learn 

Theoretic 

Theoretic 

Calculated 

- 

- 

YEAR 

Dollars 

BYTl 

Curve 

CYTl 

Baseline 

Current 

Qty  Var 

1991 

1981 

551.19 

0.91 

581.18 

59830.32 

36837.18 

12191.13 

- 

- 

1992 

1981 

551.19 

0.91 

581.18 

59830.32 

36837.18 

18267.73 

- 

- 

1993 

1981 

551.19 

0.91 

581.18 

59830.32 

14216.00 

48582.25 

- 

- 

1994 

1981 

551.19 

0.91 

581.18 

59830.32 

14216.00 

46879.84 

- 

- 

1995 

1996 

551.19 

0.91 

581.18 

59830.32 

36837.18 

38572.36 

- 

- 

1996 

1996 

551.19 

0.91 

581.18 

59830.32 

36837.18 

37751.34 

- 

- 

1997 

1996 

551.19 

0.91 

581.18 

59830.32 

36837.18 

38745.47 

- 

1998 

1996 

551.19 

0.91 

581.18 

59830.32 

40534.10 

36829.81 

- 

- 

1999 

1996 

551.19 

0.91 

581.18 

59830.32 

40534.10 

36985.88 

- 

- 

2000 

1996 

551.19 

0.91 

581.18 

59830.32 

40534.10 

36985.88 

- 

- 

2001 

1996 

551.19 

0.91 

581.18 

59830.32 

52348.02 

27506.40 

- 

- 

1  1 

1  Unadjusted  CGFs  I 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PROC 

MILCON 

Program 

- 

YEAR 

ACGF 

ACGF 

lUN-ACGF  UN-ACGF 

UN-ACGF 

UN-ACGF 

1991 

- 

1.43 

1.43 

- 

1.36 

0.90 

2.36 

0.98 

- 

1992 

- 

1.65 

1.61 

- 

1.36 

1.04 

1.71 

1.09 

- 

1993 

- 

2.72 

2.52 

- 

1.41 

0.50 

1.50 

0.64 

- 

1994 

- 

2.66 

2.47 

_ 

1.41 

0.50 

1.25 

0.64 

- 

1995 

- 

2.37 

2.26 

- 

1.64 

1.21 

1.87 

2.05 

- 

1996 

- 

2.34 

2.23 

- 

1.65 

1.20 

2.02 

2.04 

- 

1997 

- 

2.37 

2.26 

- 

1.65 

1.21 

2.01 

2.06 

- 

1998 

- 

2.30 

2.21 

- 

1.68 

1.34 

2.04 

2.24 

- 

1999 

- 

2.31 

2.22 

1.69 

1.35 

2.07 

2.25 

- 

2000 

- 

2.31 

2.22 

1.69 

1.35 

2.07 

2.25 

- 

2001 

- 

1.97 

1.96 

- 

1.78 

1.76 

4.27 

2.85 

- 
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Appendix  D,  KC-135R  (Stratotanker)  ACGF  Calculations 


BY  1981  Dollars  In  Millions 


CY  2000  Dollars  In  Millions 


MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

RDTE 

PROC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

88.30 

4941.80 

0.00 

5030.10 

150.14 

8360.35 

0.00 

8510.49 

BY  1981  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Current 

Cnrrent 

RDTE 

PROC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

89.70 

4498.50 

0.00 

4588.20 

152.53 

7610.39 

0.00 

7762.91 

89.70 

4416.10 

0.00 

4505.80 

152.53 

7470.99 

0.00 

7623.51 

89.70 

4535.60 

0.00 

4625.30 

152.53 

7673.15 

0.00 

7825.68 

89.70 

4596.30 

0.00 

4686.00 

152.53 

7775.84 

0.00 

7928.37 

BY  1981  Dollars  In  Millions  Qty  Adjustment  Data 


Cnrrent  Primary  Secondary 


BY  Qty  BY  Qty  Total  BY  BY  Qty 
Var  Var  Qty  Var  Var 


-1778.40  -368.00  -2146.40 

-114.00  1.30  -112.70  5 

116.30  3.50  119.80  6 

69.60  -2.70  66.90 


Cnm  Total  Total  BY 
BY  Qty  PROC 


Residnal 
BY  Var 


-1062.80 

-1032.50 

-1032.80 

-1039.00 


CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 


Cnrrent  Primary  Secondary 


Cnm  Total  Total  CY 


CY  Qty 
Var 


CY  Qty  Total  CY  CY  Qty 


397 

-3008.63 

-622.57 

-3631.20 

1048.05 

-749.96 

390 

-192.86 

2.20 

-190.66 

857.38 

-889.36 

400 

196.75 

5.92 

202.67 

1060.06 

-687.19 

406 

117.75 

-4.57 

113.18 

1173.24 

-584.50 

Leaning  Cnrve  Analysis  Applied  To  Qty  Variances  | 

CY 

CY 

CY 

Learn 

Theoretic 

Theoretic 

Calcnlated 

BY  T1  Cnrve 

CYTl 

Baseline 

Cnrrent 

Qty  Var 

75.3 

0.79 

127.41 

6051.60 

6787.75 

-1603.00 

75.3 

0.79 

127.41 

6051.60 

6708.00 

-1575.82 

75.3 

0.79 

127.41 

6051.60 

6821.79 

-1549.98 

75.3 

0.79 

127.41 

6051.60 

6889.60 

-1543.94 

Residnal 
CY  Var 


-1798.00 

-1746.74 

-1747.25 

-1757.74 


Adjusted  CGFs 


Total 

PROC  Program 
\CGF  ACGF 


.81 
.82 

0.81  0.82 

0.82  0.82 


Unadjusted  CGFs 


Total 

RDTE  PROC  MILCON  Program 
UN-ACGF  UN-ACGF  UN-ACGF  UN-ACGF 


.91 

.90 

.92 

.93 


1.02 

0.91 

#DIV/0! 

1.02 

0.89 

#DIV/0! 

1.02 

0.92 

#DIV/0! 

1.02 

0.93 

#DIV/0! 
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Appendix  E,  AV-8B  (Harrier)  ACGF  Calculations 


1  1 

1  BY  1979  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PROC 

Mil  CON 

Total 

1981 

336 

882.00 

4912.00 

1.80 

5795.80 

1801.10 

9991.86 

3.42 

11796.38 

1  1 

1  BY  1979  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

Cnrrent 

YEAR 

Dollars 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PROC 

Mil  CON 

Total 

1991 

1979 

3783.90 

5.50 

4917.00 

2302.63 

7697.11 

10.44 

10010.18 

1992 

1979 

3813.00 

5.50 

4973.80 

2359.20 

7756.31 

10.44 

10125.94 

1  1 

1  BY  1979  Dollars  In  Millions  Qty  Adjustment  Data 

Cnrrent 

Primary 

Secondary 

Cnm  Total 

Total  BY 

SAR 

BY 

PROC 

BY  Qty 

BY  Qty 

Total  BY 

BY  Qty 

PROC 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

BY  Var 

1991 

1979 

-1128.10 

-666.90 

- 

1992 

1979 

0.00 

-1099.00 

-637.80 

- 

1  1 

1  CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 

Current 

Primary 

Secondary 

Cnm  Total 

Total  CY 

SAR 

BY 

PROC 

CY  Qty 

CY  Qty 

Total  CY 

CY  Qty 

PROC 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

CY  Var 

1991 

1979 

279 

73.84 

4.48 

78.32 

-938.16 

-2294.75 

-1356.59 

- 

1992 

1979 

279 

0.00 

0.00 

-938.16 

-2235.56 

-1297.40 

- 

1  1 

1  Leaning  Cnrve  Analysis  Applied  To  Qty  Varianees  | 

1  1 

CY 

CY 

CY 

SAR 

BY 

Learn 

Theoretic 

Theoretic 

Calcnlated 

- 

- 

YEAR 

Dollars 

BY  T1 

Cnrve 

CYTl 

Baseline 

Cnrrent 

Qty  Var 

1991 

1979 

96.85 

0.78 

■■■ 

8359.24 

7415.68 

-1529.20 

- 

- 

1992 

1979 

96.85 

0.78 

■Bl 

8359.24 

7415.68 

-1462.48 

- 

- 

1  Adjusted  CGFs  | 

1  Unadjnsted  CGFs 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PROC 

Mil. CON 

Program 

- 

YEAR 

ACGF 

ACGF 

1  UN- ACGF  UN- ACGF  UN- ACGF  UN- ACGF 

1991 

- 

0.85 

* 

1.28 

0.77 

3.06 

0.85 

- 

1992 

- 

0.85 

- 

1.31 

0.78 

3.06 

0.86 

- 
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Appendix  F,  AV-8B  (Remanufacture)  ACGF  Calculations 


BY  1994  Dollars  In  Millions 

CY  2000  Dollars  In  Millions 

MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PRQC 

Mil  CON 

Total 

1994 

72 

0.00 

1920.90 

0.00 

1920.90 

0.00 

2089.30 

0.00 

2089.30 

BY  1994  Dollars  In  Millions 

CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

YEAR 

Dollars 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PRQC 

Mil  CON 

Total 

1995 

1994 

0.00 

2041.00 

0.00 

2041.00 

0.00 

2219.93 

0.00 

2219.93 

1996 

1994 

0.00 

1959.50 

0.00 

1959.50 

0.00 

2131.28 

0.00 

2131.28 

1997 

1994 

0.00 

1888.40 

0.00 

1888.40 

0.00 

2053.95 

0.00 

2053.95 

1998 

1994 

0.00 

1949.30 

0.00 

1949.30 

0.00 

2120.19 

0.00 

2120.19 

1999 

1994 

0.00 

1961.30 

0.00 

1961.30 

0.00 

2133.24 

0.00 

2133.24 

2000 

1994 

0.00 

1957.20 

0.00 

1957.20 

0.00 

2128.78 

0.00 

2128.78 

2001 

1994 

0.00 

1991.60 

0.00 

1991.60 

0.00 

2166.20 

0.00 

2166.20 

BY  1994  Dollars  In  Millions  Qty  Adjnstment  Data 

Current 

Primary 

Secondary 

Cnm  Total 

Total  BY 

SAR 

BY 

PROC 

BY  Qty 

BY  Qty 

Total  BY 

BY  Qty 

PROC 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

BY  Var 

1995 

1994 

72 

0.00 

0.00 

0.00 

-28.50 

120.10 

148.60 

- 

1996 

1994 

72 

0.00 

0.00 

-28.50 

38.60 

67.10 

- 

1997 

1994 

72 

0.00 

0.00 

0.00 

-28.50 

-32.50 

-4.00 

- 

1998 

1994 

72 

0.00 

0.00 

0.00 

-28.50 

28.40 

56.90 

- 

1999 

1994 

72 

0.00 

0.00 

0.00 

-28.50 

40.40 

68.90 

- 

2000 

1994 

72 

0.00 

0.00 

0.00 

-28.50 

36.30 

64.80 

- 

2001 

1994 

74 

37.10 

-2.20 

34.90 

6.40 

70.70 

64.30 

- 

CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 

Current 

Primary 

Secondary 

Cnm  Total 

Total  CY 

SAR 

BY 

PROC 

CY  Qty 

CYQty 

Total  CY 

CYQty 

PROC 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

CY  Var 

1995 

1994 

72 

0.00 

0.00 

0.00 

-31.00 

130.63 

161.63 

- 

1996 

1994 

72 

0.00 

0.00 

0.00 

-31.00 

41.98 

72.98 

- 

1997 

1994 

72 

0.00 

0.00 

0.00 

-31.00 

-35.35 

-4.35 

- 

1998 

1994 

72 

0.00 

0.00 

0.00 

-31.00 

30.89 

61.89 

- 

1999 

1994 

72 

0.00 

0.00 

0.00 

-31.00 

43.94 

74.94 

- 

2000 

1994 

72 

0.00 

0.00 

0.00 

-31.00 

39.48 

70.48 

- 

2001 

1994 

74 

-2.39 

37.96 

6.96 

76.90 

69.94 

- 
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Leaning  Cnrve  Analysis  Applied  To  Qty  Variances 

CY 

CY 

CY 

SAR 

BY 

Learn 

Theoretie 

Theoretic 

Calculated 

- 

YEAR 

Dollars 

BY  T1 

Curve 

CY  T1 

Baseline 

Current 

Qty  Var 

1995 

1994 

39.94 

0.94 

43.44 

2151.68 

2151.68 

161.63 

- 

- 

1996 

1994 

39.94 

0.94 

43.44 

2151.68 

2151.68 

72.98 

- 

1997 

1994 

39.94 

0.94 

43.44 

2151.68 

2151.68 

-4.35 

- 

1998 

1994 

39.94 

0.94 

43.44 

2151.68 

2151.68 

61.89 

- 

1999 

1994 

39.94 

0.94 

43.44 

2151.68 

2151.68 

74.94 

- 

2000 

1994 

39.94 

0.94 

43.44 

2151.68 

2151.68 

70.48 

- 

2001 

1994 

39.94 

0.94 

43.44 

2151.68 

2206.16 

68.21 

- 

Adjusted  CGEs 

Unadjusted  CGEs 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PROC 

MILCON 

Program 

- 

YEAR 

ACGE 

ACGE 

UN-ACGF  UN-ACGF  UN-ACGF  UN-ACGF 

1995 

- 

1.08 

1.08 

- 

#DlV/0! 

1.06 

#DlV/0! 

1.06 

- 

1996 

- 

1.03 

1.03 

- 

#DlV/0! 

1.02 

#DlV/0! 

1.02 

- 

1997 

- 

- 

#DlV/0! 

0.98 

#DlV/0! 

0.98 

- 

1998 

- 

1.03 

1.03 

- 

#DlV/0! 

1.01 

#DlV/0! 

1.01 

- 

1999 

- 

1.04 

1.04 

- 

#DlV/0! 

1.02 

#DlV/0! 

1.02 

- 

2000 

- 

1.03 

1.03 

- 

#DlV/0! 

1.02 

#DlV/0! 

1.02 

- 

2001 

- 

1.03 

1.03 

- 

#DlV/0! 

1.04 

#DlV/0! 

1.04 

- 
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Appendix  G.  F-14D  (Tomcat)  ACGF  Calculations 


1  1 

1  BY  1989  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PROC 

Mil  CON 

Total 

1986 

527 

1696.50 

16152.50 

11.80 

17860.80 

2393.82 

22138.84 

16.57 

24549.23 

1  1 

1  BY  1989  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

YEAR 

Dollars 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PROC 

Mil  CON 

Total 

M3M 

1989 

1836.50 

4308.70 

15.50 

6160.70 

2320.57 

5297.15 

19.30 

7637.02 

mSSm 

1989 

1887.40 

4294.00 

12.20 

6193.60 

2384.89 

5279.08 

15.19 

7679.15 

1989 

1827.00 

4268.00 

12.20 

6107.20 

2308.57 

5247.11 

15.19 

7570.87 

1  1 

1  BY  1989  Dollars  In  Millions  Qty  Adjustment  Data 

Current 

Primary 

Secondary 

Cnm  Total 

Total  BY 

SAR 

BY 

PROC 

BY  Qty 

BY  Qty 

Total  BY 

BY  Qty 

PROC 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

BY  Var 

M3M 

1989 

55 

401.80 

860.50 

1262.30 

-12685.60 

-11843.80 

■■■ 

- 

1989 

55 

0.00 

0.00 

0.00 

-12685.60 

-11858.50 

- 

■BB 

1989 

55 

0.00 

0.00 

0.00 

-12685.60 

-11884.50 

- 

1  1 

1  CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 

Current 

Primary 

Secondary 

Cnm  Total 

Total  CY 

SAR 

BY 

PROC 

CY  Qty 

CYQty 

Total  CY 

CYQty 

PROC 

Residnal 

- 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

CY  Var 

■BB 

1989 

55 

493.98 

1057.91 

1551.88 

-15595.77 

-14560.86 

1034.92 

- 

1989 

55 

0.00 

0.00 

0.00 

-15595.77 

-14578.93 

1016.84 

- 

■BB 

1989 

55 

0.00 

0.00 

0.00 

-15595.77 

-14610.89 

984.88 

- 

1  1 

1  Leaning  Curve  Analysis  Applied  To  Qty  Variances  | 

CY 

CY 

CY 

SAR 

BY 

Learn 

Theoretic 

Theoretic 

Calculated 

- 

- 

YEAR 

Dollars 

BY  T1 

Curve 

CY  T1 

Baseline 

Current 

Qty  Var 

■BB 

1989 

143.84 

0.89 

176.84 

31829.87 

4893.47 

6731.67 

- 

- 

1989 

143.84 

0.89 

176.84 

31829.87 

4893.47 

6614.11 

- 

- 

■BB 

1989 

143.84 

0.89 

176.84 

31829.87 

4893.47 

6406.20 

- 

- 

1  1 

1  Adjusted  CGEs  | 

1  Unadjnsted  CGEs 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PROC 

MILCON 

Program 

- 

YEAR 

ACGF 

ACGF 

1  UN- ACGF  UN- ACGF  UN- ACGF  UN- ACGF 

■BB 

MSSM 

1.27 

- 

1.16 

- 

1.27 

- 

0.92 

- 

■BB 

mbm 

1.26 

- 

0.92 

- 
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Appendix  H.  F-16  (Fighting  Falcon)  ACGF  Calculations 


SAR 

YEAR 


991 

992 

993 

994 


MSII 

Baseline 

Qty 


650 


BY  1975  Dollars  In  Millions 


CY  2000  Dollars  In  Millions 


MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PRQC 

MIT  CON 

Total 

578.60 

3798.20 

0.00 

4376.80 

1657.88 

11148.22 

0.00 

12806.10 

BY  1975  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PRQC 

MIT  CON 

Total 

1395.40 

14401.10 

0.00 

15796.50 

3998.28 

42269.15 

0.00 

46267.43 

1143.90 

15063.60 

0.00 

16207.50 

3277.65 

44213.68 

0.00 

47491.33 

1242.40 

14603.30 

0.00 

15845.70 

3559.89 

42862.64 

0.00 

46422.52 

1453.60 

14568.50 

0.00 

16022.10 

4165.04 

42760.49 

0.00 

46925.54 

BY  1975  Dollars  In  Millions  Qty  Adjustment  Data 


Current  Primary  Seeondary 


Cnm  Total  Total  BY 


BY  Qty  BY  Qty  Total  BY  BY  Qty 
Var  Var  Qty  Var  Var 


143.10  174.60  317.70  317.70 

0.00  0.00  0.00  317.70 

0.00  0.00  0.00  0.00 

0.00  0.00  0.00  0.00 


PRQC  Residnal 
Var  BY  Var 


10602.90  10285.20 

11265.40  10947.70 

10805.10  10805.10 

10770.30  10770.30 


CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 


Current  Primary  Seeondary 


Cnm  Total  Total  CY 


CY  Qty  CY  Qty  Total  CY  CY  Qty 
Var  Var  Qty  Var  Var 


420.02  512.47  932.49  932.49 

0.00  0.00  0.00  932.49 

0.00  0.00  0.00  0.00 

0.00  0.00  0.00  0.00 


PRQC  Residnal 
Var  CY  Var 


31120.93  30188.44 

33065.45  32132.96 

31714.41  31714.41 

31612.27  31612.27 


1  Leaning  Cnrve  Analysis  Applied  To  Qty  Variances  | 

BY  T1 

Learn 

Cnrve 

CY  T1 

CY 

Theoretic 

Baseline 

CY 

Theoretic 

Cnrrent 

CY 

Calcnlated 
Qty  Var 

13.86 

0.93 

40.69 

13559.06 

40286.36 

10160.44 

13.86 

0.93 

40.69 

13559.06 

41077.72 

10606.55 

13.86 

0.93 

40.69 

13559.06 

40484.36 

10621.82 

13.86 

0.93 

40.69 

13559.06 

40484.36 

10587.61 

Adjnsted  CGFs 


Total 

ROC  Program 
.CGF  ACGF 


Unadjnsted  CGFs 


Total 

MILCON  Program 


.91 

1.98 

.95 

1.95 

.95 

1.98 

.95 

2.02 
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Appendix  I.  F-22  (Raptor)  ACGF  Calculations 


1 

BY  1990  Dollars  In  Millions 

CY  2000  Dollars  In  Millions 

MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PRQC 

MIT  CON 

Total 

1991 

648 

16833.90 

43980.60 

200.00 

61014.50 

20464.26 

52270.74 

240.27 

72975.27 

- - - 

BY  1990  Dollars  In  Millions 

CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

YEAR 

Dollars 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

1992 

1990 

16481.90 

44106.10 

120.40 

60708.40 

20036.35 

52419.90 

144.64 

72600.89 

1993 

1990 

16388.90 

32565.80 

119.60 

49074.30 

19923.29 

38704.30 

143.68 

58771.28 

1994 

1990 

16896.70 

32564.50 

121.00 

49582.20 

20540.60 

38702.76 

145.36 

59388.72 

1995 

1990 

18488.50 

32696.10 

136.00 

51320.60 

22475.69 

38859.16 

163.38 

61498.23 

1996 

1990 

19391.10 

31640.90 

139.10 

51171.10 

23572.94 

37605.06 

167.11 

61345.11 

1997 

1990 

19714.90 

28286.10 

137.80 

48138.80 

23966.57 

33617.90 

165.55 

57750.01 

1998 

1990 

19907.60 

28344.40 

157.90 

48409.90 

24200.83 

33687.19 

189.69 

58077.71 

1999 

1990 

20973.60 

27137.70 

196.60 

48307.90 

25496.72 

32253.03 

236.18 

57985.93 

2000 

1990 

20973.60 

27137.70 

196.60 

48307.90 

25496.72 

32253.03 

236.18 

57985.93 

2001 

1990 

22495.10 

31277.70 

356.40 

54129.20 

27346.34 

37173.40 

428.16 

64947.90 

SAR 

BY 

YEAR 

Dollars 

1992 

1993 

1990 

1990 

1994 

1990 

1995 

1990 

1996 

1990 

1997 

1990 

1998 

1990 

1999 

1990 

2000 

1990 

2001 

1990 

Current 

PROC 

Qty 


BY  1990  Dollars  In  Millions  Qty  Adjustment  Data 


Primary  Secondary 
BY  Qty  BY  Qty 


Total  BY 


Cnm  Total 
BY  Qty 
Var 


Total  BY 
PRQC 
Var 


Residnal 
BY  Var 


0.00 

0.00 

0.00 

0.00 

125.50 

125.50 

-9891.20 

-1742.70 

-11633.90 

-11633.90 

-11414.80 

219.10 

0.00 

0.00 

0.00 

-11633.90 

-11416.10 

217.80 

-190.00 

0.00 

-190.00 

-11823.90 

-11284.50 

539.40 

0.00 

-178.00 

-178.00 

-12001.90 

-12339.70 

-337.80 

-5143.40 

825.40 

-4318.00 

-16319.90 

-15694.50 

625.40 

0.00 

0.00 

0.00 

-16319.90 

-15636.20 

683.70 

-1089.90 

0.00 

-1089.90 

-17409.80 

-16842.90 

566.90 

0.00 

0.00 

0.00 

-17409.80 

-16842.90 

566.90 

220.90 

5.90 

226.80 

-17183.00 

-12702.90 

4480.10 

CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 


SAR 

YEAR 

BY 

Dollars 

Current 

PROC 

Qty 

Primary 
CY  Qty 
Var 

Secondary 

CYQty 

Var 

Total  CY 
Qty  Var 

Cnm  Total 
CYQty 
Var 

Total  CY 

PRQC 

Var 

Residnal 

CY  Var 

1992 

648 

0.00 

0.00 

0.00 

0.00 

149.16 

149.16 

1993 

1990 

442 

-11755.65 

-2071.19 

-13826.84 

-13826.84 

-13566.44 

260.40 

1994 

1990 

442 

0.00 

0.00 

0.00 

-13826.84 

-13567.98 

258.85 

1995 

1990 

438 

-225.81 

0.00 

-225.81 

-14052.65 

-13411.58 

641.07 

1996 

1990 

438 

0.00 

-211.55 

-211.55 

-14264.20 

-14665.68 

-401.47 

1997 

1990 

339 

-6112.91 

980.98 

-5131.92 

-19396.13 

-18652.84 

743.29 

1998 

1990 

339 

0.00 

0.00 

0.00 

-19396.13 

-18583.55 

812.57 

1999 

1990 

333 

-1295.34 

0.00 

-1295.34 

-20691.47 

-20017.71 

673.76 

2000 

1990 

333 

0.00 

0.00 

0.00 

-20691.47 

-20017.71 

673.76 

2001 

1990 

333 

262.54 

7.01 

269.55 

-20421.92 

-15097.34 

5324.58 

83 


1  1 

1  Leaning  Cnrve  Analysis  Applied  To  Qty  Variances  | 

1  1 

CY 

CY 

CY 

SAR 

BY 

Learn 

Theoretic 

Theoretic 

Calculated 

- 

- 

YEAR 

Dollars 

BY  T1 

Curve 

CY  T1 

Baseline 

Current 

Qty  Var 

1992 

1990 

468.41 

0.83 

556.70 

65822.16 

65822.16 

149.16 

- 

- 

1993 

1990 

468.41 

0.83 

556.70 

65822.16 

49645.63 

345.25 

- 

- 

1994 

1990 

468.41 

0.83 

556.70 

65822.16 

49645.63 

343.20 

- 

- 

1995 

1990 

468.41 

0.83 

556.70 

65822.16 

49314.01 

855.68 

- 

- 

1996 

1990 

468.41 

0.83 

556.70 

65822.16 

49314.01 

-535.87 

- 

- 

1997 

1990 

468.41 

0.83 

556.70 

65822.16 

40825.98 

1198.37 

- 

- 

1998 

1990 

468.41 

0.83 

556.70 

65822.16 

40825.98 

1310.08 

- 

- 

1999 

1990 

468.41 

0.83 

556.70 

65822.16 

40292.03 

1100.67 

- 

- 

2000 

1990 

468.41 

0.83 

556.70 

65822.16 

40292.03 

1100.67 

- 

- 

2001 

1990 

468.41 

0.83 

556.70 

65822.16 

40292.03 

8698.38 

- 

- 

1  1 

1  Adjnsted  CGEs  | 

1  Unadjnsted  CGEs 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PROC 

MILCON 

Program 

- 

YEAR 

ACGE 

ACGE 

1  UN- ACGE  UN- ACGE  UN- ACGE  UN- ACGE 

1992 

- 

1.00 

- 

0.98 

1.00 

0.60 

0.99 

- 

1993 

- 

1.01 

- 

0.97 

0.74 

0.60 

0.80 

- 

1994 

- 

1.01 

1.00 

- 

1.00 

0.74 

0.61 

0.81 

- 

1995 

- 

1.02 

1.04 

- 

1.10 

0.74 

0.68 

0.84 

- 

1996 

- 

0.99 

1.03 

- 

1.15 

0.72 

0.70 

0.84 

- 

1997 

- 

1.02 

1.06 

- 

1.17 

0.64 

0.69 

0.79 

- 

1998 

- 

1.03 

1.07 

- 

1.18 

0.64 

0.79 

0.79 

- 

1999 

- 

1.02 

1.08 

- 

1.25 

0.62 

0.98 

0.79 

- 

2000 

- 

1.02 

1.08 

- 

1.25 

0.62 

0.98 

0.79 

- 

2001 

- 

1.17 

1.22 

- 

1.34 

0.71 

1.78 

0.89 

- 
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Appendix  J.  FA-18  E/F  (Super  Hornet)  ACGF  Calculations 


1  1 

1  BY  1990  &  2000  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PROC 

MILCQN 

Total 

RDTE 

PRQC 

MILCQN 

Total 

1992 

1000 

4927.40 

48771.50 

0.00 

53698.90 

5990.03 

57964.70 

0.00 

63954.7 

1  1 

1  BY  1990  &  2000  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions  | 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Current 

Current 

Current 

Current 

Current 

Current 

Current 

Current 

YEAR 

Dollars 

RDTE 

PROC 

MILCQN 

Total 

RDTE 

PRQC 

MILCQN 

Total 

1993 

1990 

4927.40 

48931.40 

0.00 

53858.80 

5990.03 

58154.74 

0.00 

64144.77 

1994 

1990 

4867.80 

49320.00 

0.00 

54187.80 

5917.58 

58616.59 

0.00 

64534.17 

1995 

1990 

4672.60 

50015.00 

0.00 

54687.60 

5680.28 

59442.60 

0.00 

65122.88 

1996 

1990 

4754.40 

47546.80 

0.00 

52301.20 

5779.72 

56509.15 

0.00 

62288.87 

1997 

1990 

4871.20 

29422.10 

0.00 

34293.30 

5921.71 

34968.03 

0.00 

40889.74 

1998 

1990 

4853.20 

30771.50 

0.00 

35624.70 

5899.83 

36571.79 

0.00 

42471.61 

1999 

1990 

4833.60 

30991.20 

0.00 

35824.80 

5876.00 

36832.90 

0.00 

42708.90 

2000 

2000 

5889.40 

37600.20 

0.00 

43489.60 

5889.40 

37600.20 

0.00 

43489.60 

2001 

2000 

5894.80 

39394.90 

0.00 

45289.70 

5894.80 

39394.90 

0.00 

45289.70 

1  1 

1  BY  1990  &  2000  Dollars  In  Millions  Qty  Adjustment  Data  | 

Primary 

Secondary 

Cum  Total 

SAR 

BY 

Current 

BY  Qty 

BY  Qty 

Total  BY 

BY  Qty 

Total  BY 

Residual 

- 

YEAR 

Dollars 

PROC  Qty 

Var 

Var 

Qty  Var 

Var 

PRQC  Var 

BY  Var 

1993 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

159.90 

159.90 

- 

1994 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

548.50 

548.50 

- 

1995 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

1243.50 

1243.50 

- 

1996 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

-1224.70 

-1224.70 

- 

1997 

1990 

548 

-14908.10 

-2642.80 

-17550.90 

-17550.90 

-19349.40 

-1798.50 

- 

1998 

1990 

548 

0.00 

0.00 

0.00 

0.00 

-18000.00 

-18000.00 

- 

1999 

1990 

548 

0.00 

0.00 

0.00 

0.00 

-17780.30 

-17780.30 

- 

2000 

2000 

548 

0.00 

0.00 

0.00 

0.00 

-11171.30 

-11171.30 

- 

2001 

2000 

548 

54.90 

21.60 

76.50 

76.50 

-9376.60 

-9453.10 

- 

1  1 

1  CY  2000  Dollars  In  Millions  Qty  Adjustment  Data  | 

Primary 

Secondary 

Cum  Total 

SAR 

BY 

Current 

CY  Qty 

CY  Qty 

Total  CY 

CY  Qty 

Total  CY 

Residual 

- 

YEAR 

Dollars 

PROC  Qty 

Var 

Var 

Qty  Var 

Var 

PRQC  Var 

CY  Var 

1993 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

190.04 

190.04 

- 

1994 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

651.89 

651.89 

- 

1995 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

1477.89 

1477.89 

- 

1996 

1990 

1000 

0.00 

0.00 

0.00 

0.00 

-1455.55 

-1455.55 

- 

1997 

1990 

548 

-17718.21 

-3140.96 

-20859.16 

-20859.16 

-22996.67 

-2137.51 

- 

1998 

1990 

548 

0.00 

0.00 

0.00 

0.00 

-21392.92 

-21392.92 

- 

1999 

1990 

548 

0.00 

0.00 

0.00 

0.00 

-21131.80 

-21131.80 

- 

2000 

2000 

548 

0.00 

0.00 

0.00 

0.00 

-11171.30 

-11171.30 

- 

2001 

548 

54.90 

21.60 

76.50 

76.50 

-9376.60 

-9453.10 

- 
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1  1 

1  Leaning  Curve  Analysis  Applied  To  Qty  Varianees  | 

1  1 

CY 

CY 

CY 

SAR 

BY 

Learn 

Theoretie 

Theoretie 

Caleulated 

- 

- 

YEAR 

Dollars 

BYTl 

Curve 

CYTl 

Baseline 

Current 

Qty  Var 

1993 

1990 

356.58 

0.83 

356.58 

58599.85 

58599.85 

190.04 

- 

1994 

1990 

356.58 

0.83 

356.58 

58599.85 

58599.85 

651.89 

- 

- 

1995 

1990 

356.58 

0.83 

356.58 

58599.85 

58599.85 

1477.89 

- 

- 

1996 

1990 

356.58 

0.83 

356.58 

58599.85 

58599.85 

-1455.55 

- 

- 

1997 

1990 

356.58 

0.83 

356.58 

58599.85 

37580.76 

-3333.03 

- 

- 

1998 

1990 

356.58 

0.83 

356.58 

58599.85 

37580.76 

-33358.07 

- 

- 

1999 

1990 

356.58 

0.83 

356.58 

58599.85 

37580.76 

-32950.92 

- 

- 

2000 

2000 

356.58 

0.83 

356.58 

58599.85 

37580.76 

-17419.46 

- 

- 

2001 

2000 

356.58 

0.83 

356.58 

58599.85 

37580.76 

-14740.26 

- 

- 

1  Adjusted  CGEs  | 

1  Unadjusted  CGEs  | 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PROC 

MILCON 

Program 

- 

YEAR 

ACGE 

ACGE 

lUN-ACGF  UN-ACGE 

UN-ACGE 

UN-ACGE 

1993 

- 

- 

1.00 

1.00 

#DlV/0! 

1.00 

- 

1994 

- 

- 

0.99 

1.01 

#DlV/0! 

1.01 

- 

1995 

- 

- 

0.95 

1.03 

#DlV/0! 

1.02 

- 

1996 

- 

- 

0.96 

0.97 

#DlV/0! 

0.97 

- 

1997 

- 

0.94 

0.95 

- 

0.99 

0.60 

#DlV/0! 

0.64 

- 

1998 

- 

0.42 

0.48 

- 

0.98 

0.63 

#DlV/0! 

0.66 

- 

1999 

- 

0.43 

0.48 

- 

0.98 

0.64 

#DlV/0! 

0.67 

- 

2000 

- 

0.70 

0.73 

- 

0.98 

0.65 

#DlV/0! 

0.81 

- 

2001 

- 

0.75 

0.77 

- 

0.98 

0.68 

#DlV/0! 

0.84 

- 
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Appendix  K,  FA-18  (Hornet)  ACGF  Calculations 


BY  1975  Dollars  In  Millions 


CY  2000  Dollars  In  Millions 


MSII 

Baseline 

Year 


1976 


SAR 

YEAR 


991 

992 

993 

994 


SAR 

YEAR 


SAR 

YEAR 


991 

992 

993 

994 


SAR 

YEAR 


991 

992 

993 

994 


SAR 

YEAR 


991 

992 

993 

994 


MSII 

Baseline 

Qty 


800 


Dollars 


975 

975 

975 

975 


MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

1526.60 

6523.10 

18.00 

8067.70 

4374.21 

19146.17 

47.39 

23567.78 

BY  1975  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Cnrrent 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

1720.00 

13542.30 

21.10 

15283.40 

4928.37 

39748.46 

55.56 

44732.38 

1948.60 

12761.20 

23.70 

14733.50 

5583.38 

37455.83 

62.40 

43101.61 

1938.60 

12543.50 

21.40 

14503.50 

5554.73 

36816.85 

56.35 

42427.92 

1960.60 

11984.40 

21.40 

13966.40 

5617.77 

35175.81 

56.35 

40849.92 

BY  1975  Dollars  In  Millions  Qty  Adjustment  Data 


Cnrrent  Primary  Secondary 


Cnm  Total  Total  BY 


BY 

Dollars 


BY  Qty 
Var 


BY  Qty  Total  BY  BY  Qty 


Residnal 
BY  Var 


991 

975 

992 

975 

993 

975 

994 

975 

I 


157 

0.00 

0.00 

0.00 

1848.50 

7019.20 

5170.70 

175 

-362.60 

-319.50 

-682.10 

1166.40 

6238.10 

5071.70 

151 

-117.80 

-109.20 

-227.00 

939.40 

6020.40 

5081.00 

115 

-170.80 

-125.10 

-295.90 

643.50 

5461.30 

4817.80 

CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 


BY 

Dollars 


975 

975 

975 

975 


BY 

Dollars 


975 

975 

975 

975 


Current  Primary 

Secondary 

Cnm  Total 

Total  CY 

PROC 

CY  Qty 

CYQty 

Total  CY 

CYQty 

PROC 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

1157 

0.00 

0.00 

0.00 

5425.59 

20602.29 

1075 

-1064.28 

-937.78 

-2002.05 

3423.54 

18309.66 

1051 

-345.76 

-320.52 

-666.28 

2757.26 

17670.68 

1015 

-501.32 

-367.19 

-868.51 

1888.76 

16029.64 

Leaning  Cnrve  Analysis  Applied  To  Qty  Varianees  | 

CY 

CY 

CY 

Learn 

Theoretic 

Theoretic 

Calcnlated 

BY  T1 

Curve 

CY  T1 

Baseline 

Current 

Qty  Var 

71.76 

0.83 

210.62 

28105.98 

36822.23 

11584.20 

71.76 

0.83 

210.62 

28105.98 

34893.01 

11990.62 

71.76 

0.83 

210.62 

28105.98 

34320.99 

12212.82 

71.76 

0.83 

210.62 

28105.98 

33456.35 

11879.47 

Residnal 
CY  Var 


15176.70 

14886.12 

14913.41 

14140.89 


Adjnsted  CGFs 


Total 


Unadjnsted  CGFs 


PROC 

ACGF 


Program 

ACGF 


Total 

MILCON  Program 


.61  ] 

1.52 

.63  1 

1.56 

.64  ] 

1.57 

.62  ] 

1.56 
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Appendix  L,  T-6A  (JPATS)  ACGF  Calculations 


BY  1995  Dollars  In  Millions 


CY  2000  Dollars  In  Millions 


MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

1995 

711 

293.50 

2276.00 

62.50 

2632.00 

344.20 

2629.69 

72.88 

3046.77 

1  BY  1995  &  2002  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Current 

Current 

Current 

Current 

Current 

Current 

Current 

Current 

YEAR 

Dollars 

RDTE 

PRQC 

MIT  CON 

Total 

RDTE 

PROC 

MIT  CON 

Total 

1996 

1995 

320.80 

2501.20 

37.20 

2859.20 

345.54 

2675.65 

40.09 

3061.29 

1997 

1995 

263.50 

2931.90 

34.00 

3229.40 

283.82 

3136.39 

36.65 

3456.86 

1998 

1995 

263.80 

2951.30 

35.40 

3250.50 

284.14 

3157.15 

38.15 

3479.45 

1999 

1995 

257.50 

3058.40 

35.90 

3351.80 

277.36 

3271.72 

38.69 

3587.77 

2000 

1995 

257.50 

3058.40 

35.90 

3351.80 

277.36 

3271.72 

38.69 

3587.77 

2001 

2002 

289.80 

4244.70 

62.80 

4597.30 

279.41 

4098.78 

60.36 

4438.55 

SAR 

YEAR 

BY 

Dollars 

1996 

1995 

1997 

1995 

1998 

1995 

1999 

1995 

2000 

1995 

2001 

2002 

Cnrrent 

PROC 

Qty 


BY  1995  &  2002  Dollars  In  Millions  Qty  Adjustment  Data 


Primary  Secondary 
BY  Qty  BY  Qty 


Cum  Total  Total  BY 


CY  2000  Dollars  In  Millions  Qty  Adjustment  Data 


Residual 
CY  Var 


.0 

.0 

.0 

.0 

.0 


Leaning  Curve  Analysis  Applied  To  Qty  Variances 


SAR 

YEAR 


BY 

Dollars 


CY 

Theoretic 

Baseline 


Theoretic  Calculated 
Current  Qty  Var 


1996 

1995 

17.33 

0.87 

16.74 

3026.20 

3026.20 

0.00 

1997 

1995 

17.33 

0.87 

16.74 

3026.20 

3026.20 

0.00 

1998 

1995 

17.33 

0.87 

16.74 

3026.20 

3026.20 

0.00 

1999 

1995 

17.33 

0.87 

16.74 

3026.20 

3026.20 

0.00 

2000 

1995 

17.33 

0.87 

16.74 

3026.20 

3026.20 

0.00 

2001 

2002 

17.33 

0.87 

16.74 

3026.20 

3262.99 

-573.6 
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Adjusted  CGFs 

Unadjusted  CGFs 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

ROTE 

PROC 

MILCON 

Program 

- 

YEAR 

ACGF 

ACGF 

UN-ACGF  UN-ACGF  UN-ACGF  UN-ACGF 

1996 

- 

1.00 

0.99 

- 

1.02 

0.55 

1.09 

- 

1997 

- 

1.00 

0.97 

- 

0.82 

1.19 

0.50 

1.23 

- 

1998 

- 

1.00 

0.97 

- 

0.83 

1.20 

0.52 

1.23 

- 

1999 

- 

1.00 

0.97 

- 

0.81 

1.24 

0.53 

1.27 

- 

2000 

- 

1.00 

0.97 

- 

0.81 

1.24 

0.53 

1.27 

- 

2001 

- 

0.79 

- 

0.81 

1.56 

0.83 

1.75 

- 
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Appendix  M.  T-45-TS  (Goshawk)  ACGF  Calculations 


BY  1984  Dollars  In  Millions 


CY  2000  Dollars  In  Millions 


MSII 

MSII 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Year 

Qty 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PROC 

Mil  CON 

Total 

1984 

300 

491.40 

2590.80 

0.00 

3082.20 

733.32 

3770.08 

0.00 

4503.40 

1  BY  1984  &  1985  Dollars  In  Millions  | 

1  CY  2000  Dollars  In  Millions 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  BY 

MSII  CY 

MSII  CY 

MSII  CY 

MSII  CY 

SAR 

BY 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

Current 

Cnrrent 

YEAR 

Dollars 

RDTE 

PROC 

Mil  CON 

Total 

RDTE 

PROC 

Mil  CON 

Total 

1991 

1984 

605.90 

3867.40 

24.20 

4497.50 

904.19 

5627.76 

36.08 

6568.04 

1992 

1984 

635.80 

3887.90 

24.20 

4547.90 

948.81 

5657.60 

36.08 

6642.49 

1993 

1984 

641.80 

3461.50 

24.10 

4127.40 

957.77 

5037.11 

35.93 

6030.81 

1994 

1995 

874.20 

4565.20 

34.00 

5473.40 

941.62 

4883.61 

36.65 

5861.88 

1995 

1995 

867.80 

4531.30 

33.90 

5433.00 

934.73 

4847.35 

36.54 

5818.61 

1996 

1995 

1054.90 

4832.20 

33.90 

5921.00 

1136.26 

5169.23 

36.54 

6342.03 

1997 

1995 

1054.60 

4565.70 

33.90 

5654.20 

1135.93 

4884.15 

36.54 

6056.62 

1998 

1995 

1054.60 

5707.90 

33.90 

6796.40 

1135.93 

6106.01 

36.54 

7278.48 

1999 

1995 

1054.60 

4334.70 

33.90 

5423.20 

1135.93 

4637.03 

36.54 

5809.51 

2000 

1995 

1054.60 

4334.70 

33.90 

5423.20 

1135.93 

4637.03 

36.54 

5809.51 

2001 

1995 

1054.60 

4615.70 

33.90 

5704.20 

1135.93 

4937.63 

36.54 

6110.10 

SAR 

YEAR 

BY 

Dollars 

Current 

PROC 

Qty 

Primary 
BY  Qty 
Var 

Secondary 
BY  Qty 
Var 

Total  BY 
Qty  Var 

Cnm  Total 
BY  Qty 
Var 

Total  BY 

PROC 

Var 

Residnal 

BY  Var 

1991 

1984 

268 

-169.00 

-45.50 

-214.50 

-214.50 

1276.60 

1491.10 

1992 

1984 

268 

0.00 

0.00 

0.00 

-214.50 

1297.10 

1511.60 

1993 

1984 

218 

-305.50 

-224.70 

-530.20 

-744.70 

870.70 

1615.40 

1994 

1995 

174 

-366.50 

-192.10 

-558.60 

-1303.30 

1974.40 

3277.70 

1995 

1995 

174 

0.00 

0.00 

0.00 

-1303.30 

1940.50 

3243.80 

1996 

1995 

187 

216.10 

1.10 

217.20 

-1086.10 

2241.40 

3327.50 

1997 

1995 

187 

0.00 

0.00 

0.00 

-1086.10 

1974.90 

3061.00 

1998 

1995 

234 

772.30 

134.70 

907.00 

-179.10 

3117.10 

3296.20 

1999 

1995 

169 

-1071.80 

-274.00 

-1345.80 

-1524.90 

1743.90 

3268.80 

2000 

1995 

169 

0.00 

0.00 

0.00 

-1524.90 

1743.90 

3268.80 

2001 

1995 

181 

201.00 

20.70 

221.70 

-1303.20 

2024.90 

3328.10 

1  CY  2000  Dollars  In  Millions  Qty  Adjnstment  Data 

Current 

Primary 

Secondary 

Cnm  Total 

Total  CY 

SAR 

BY 

PROC 

CY  Qty 

CYQty 

Total  CY 

CYQty 

PROC 

Residnal 

YEAR 

Dollars 

Qty 

Var 

Var 

Qty  Var 

Var 

Var 

CY  Var 

1991 

1984 

268 

-245.93 

-66.21 

-312.14 

-312.14 

1857.68 

2169.82 

1992 

1984 

268 

0.00 

0.00 

0.00 

-312.14 

1887.51 

2199.65 

1993 

1984 

218 

-444.56 

-326.98 

-771.54 

-1083.67 

1267.03 

2350.70 

1994 

1995 

174 

-392.06 

-205.50 

-597.56 

-1394.20 

2112.11 

3506.31 

1995 

1995 

174 

0.00 

0.00 

0.00 

-1394.20 

2075.85 

3470.05 

1996 

1995 

187 

231.17 

1.18 

232.35 

-1161.85 

2397.73 

3559.58 

1997 

1995 

187 

0.00 

0.00 

0.00 

-1161.85 

2112.64 

3274.50 

1998 

1995 

234 

826.17 

144.09 

970.26 

-191.59 

3334.51 

3526.10 

1999 

1995 

169 

-1146.56 

-293.11 

-1439.67 

-1631.26 

1865.53 

3496.79 

2000 

1995 

169 

0.00 

0.00 

0.00 

-1631.26 

1865.53 

3496.79 

2001 

1995 

181 

215.02 

22.14 

237.16 

-1394.09 

2166.13 

3560.23 
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1  1 

1  Leaning  Cnrve  Analysis  Applied  To  Qty  Variances  | 

1  1 

CY 

CY 

CY 

SAR 

BY 

Learn 

Theoretic 

Theoretic 

Calculated 

- 

- 

YEAR 

Dollars 

BY  T1 

Curve 

CY  T1 

Baseline 

Current 

Qty  Var 

1991 

1984 

69.28 

0.87 

74.12 

7349.86 

6711.20 

2376.31 

- 

- 

1992 

1984 

69.28 

0.87 

74.12 

7349.86 

6711.20 

2408.98 

- 

- 

1993 

1984 

69.28 

0.87 

74.12 

7349.86 

5682.33 

3040.53 

- 

1994 

1995 

69.28 

0.87 

74.12 

7349.86 

4738.28 

5438.87 

- 

1995 

1995 

69.28 

0.87 

74.12 

7349.86 

4738.28 

5382.61 

_ 

- 

1996 

1995 

69.28 

0.87 

74.12 

7349.86 

5021.58 

5210.01 

_ 

- 

1997 

1995 

69.28 

0.87 

74.12 

7349.86 

5021.58 

4792.73 

- 

- 

1998 

1995 

69.28 

0.87 

74.12 

7349.86 

6016.11 

4307.82 

- 

- 

1999 

1995 

69.28 

0.87 

74.12 

7349.86 

4628.24 

5553.06 

- 

- 

2000 

1995 

69.28 

0.87 

74.12 

7349.86 

4628.24 

5553.06 

- 

- 

2001 

1995 

69.28 

0.87 

74.12 

7349.86 

4891.32 

5349.72 

_ 

- 

1  n 

1  Ad.jnsted  CGEs  | 

1  Unadjusted  CGEs 

Total 

Total 

SAR 

- 

PROC 

Program 

- 

RDTE 

PROC 

MILCON 

Program 

- 

YEAR 

ACGF 

ACGF 

1  UN- ACGF  UN- ACGF  UN- ACGF  UN- ACGF 

1991 

- 

1.63 

1.57 

- 

1.23 

1.49 

#DIV/0! 

1.46 

- 

1992 

- 

1.64 

1.59 

- 

1.29 

1.50 

#DIV/0! 

1.48 

- 

1993 

- 

1.81 

1.73 

- 

1.31 

1.34 

#DIV/0! 

1.34 

- 

1994 

- 

2.44 

2.26 

- 

1.28 

1.30 

#DIV/0! 

1.78 

- 

1995 

- 

2.43 

2.25 

- 

1.27 

1.29 

#DIV/0! 

1.76 

- 

1996 

- 

2.38 

2.25 

- 

1.55 

1.37 

#DIV/0! 

1.92 

- 

1997 

- 

2.27 

2.16 

_ 

1.55 

1.30 

#DIV/0! 

1.83 

- 

1998 

- 

2.14 

2.05 

- 

1.55 

1.62 

#DIV/0! 

2.21 

- 

1999 

- 

2.47 

2.33 

- 

1.55 

1.23 

#DIV/0! 

1.76 

- 

2000 

- 

2.47 

2.33 

- 

1.55 

1.23 

#DIV/0! 

1.76 

- 

2001 

- 

2.42 

2.29 

- 

1.55 

1.31 

#DlV/0! 

1.85 

- 
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Appendix  N.  Learning  Curve  Calculations 


1  Bl-B  (Lancer)  Learning  Curve  Calculations  In  BY  1981  Dollars  In  Millions  | 

Cum 

Cum 

Ln  Cum 

Lot 

Units 

PROC 

Units 

Ln 

y-intercept 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Slope  (b) 

(Ina) 

T1 

LCS 

1 

1 

1319.10 

1319.10 

0.00 

7.18 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

8 

4360.70 

545.09 

2.08 

6.30 

-0.42 

7.18 

1319.10 

0.74 

18 

8736.70 

485.37 

2.89 

6.18 

-0.36 

7.16 

1281.51 

0.78 

mM 

52 

13864.40 

266.62 

3.95 

5.59 

-0.39 

7.19 

1319.62 

0.76 

100 

17203.20 

172.03 

4.61 

5.15 

-0.43 

7.23 

1383.63 

0.74 

1  C130-J  (Hercules)  Learning  Curve  Calculations  In  BY  1996  Dollars  In  Millions  | 

Cum 

Cum 

Ln  Cum 

Lot 

Units 

PROC 

Units 

Ln 

y-intercept 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Slope  (b) 

(Ina) 

T1 

LCS 

1 

2 

66.70 

33.35 

0.69 

3.51 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

2 

7 

312.80 

44.69 

1.95 

3.80 

0.23 

3.35 

28.37 

1.18 

3 

16 

793.90 

49.62 

2.77 

3.90 

0.19 

3.39 

29.55 

1.14 

4 

23 

1223.00 

53.17 

3.14 

3.97 

0.19 

3.39 

29.79 

1.14 

5 

28 

1710.90 

61.10 

3.33 

4.11 

0.21 

3.37 

29.02 

1.15 

6 

29 

1849.70 

63.78 

3.37 

4.16 

0.22 

3.35 

28.45 

1.17 

7 

31 

2144.20 

69.17 

3.43 

4.24 

0.24 

3.32 

27.76 

1.18 

8 

36 

2268.10 

63.00 

3.58 

4.14 

0.23 

3.33 

27.92 

1.18 

9 

38 

2613.40 

68.77 

3.64 

4.23 

0.24 

3.32 

27.66 

1.18 

10 

42 

3101.40 

73.84 

3.74 

4.30 

0.25 

3.30 

27.22 

1.19 

11 

48 

3697.00 

77.02 

3.87 

4.34 

0.25 

3.29 

26.79 

1.19 

12 

57 

4632.50 

81.27 

4.04 

4.40 

0.26 

3.27 

26.36 

1.20 

13 

69 

5511.50 

79.88 

4.23 

4.38 

0.26 

3.27 

26.37 

1.20 

14 

81 

6358.40 

78.50 

4.39 

4.36 

0.26 

3.29 

26.72 

1.19 

15 

93 

7208.50 

77.51 

4.53 

4.35 

0.25 

3.31 

27.30 

1.19 

16 

105 

8050.90 

76.68 

4.65 

4.34 

0.24 

3.33 

28.01 

1.18 

17 

117 

8896.00 

76.03 

4.76 

4.33 

0.23 

3.36 

28.79 

1.17 

18 

129 

9743.40 

75.53 

4.86 

4.32 

0.22 

3.39 

29.60 

1.16 

19 

141 

10604.20 

75.21 

4.95 

4.32 

0.21 

3.41 

30.41 

1.16 

20 

153 

11447.00 

74.82 

5.03 

4.32 

0.20 

3.44 

31.20 

1.15 

21 

165 

12292.50 

74.50 

5.11 

4.31 

0.19 

3.47 

31.98 

1.14 

22 

168 

12612.20 

75.07 

5.12 

4.32 

0.19 

3.48 

32.59 

1.14 
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1  C-17  (Globemaster  III)  Learning  Curve  Calculations  In  BY  1996  Dollars 

[n  Millions  | 

Com 

Cnm 

Ln  Cnm 

Lot 

Units 

PROC 

Units 

Ln 

y-intercept 

Nnmber 

Prodnced 

Cost 

CAUC 

Prodnced 

(CUAC) 

Slope  (b) 

(Ina) 

T1 

LCS 

1 

2 

922.90 

461.45 

0.69 

6.13 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

2 

6 

2252.20 

375.37 

1.79 

5.93 

-0.19 

6.26 

525.65 

0.88 

3 

10 

3894.20 

389.42 

2.30 

5.96 

-0.12 

6.20 

491.87 

0.92 

4 

14 

5994.60 

428.19 

2.64 

6.06 

-0.06 

6.13 

457.17 

0.96 

5 

20 

7981.30 

399.07 

3.00 

5.99 

-0.05 

6.11 

451.65 

0.97 

6 

26 

10157.50 

390.67 

3.26 

5.97 

-0.05 

6.11 

450.43 

0.97 

7 

32 

12517.20 

391.16 

3.47 

5.97 

-0.04 

6.11 

448.32 

0.97 

8 

40 

15009.20 

375.23 

3.69 

5.93 

-0.05 

6.11 

451.10 

0.97 

9 

48 

17003.90 

354.25 

3.87 

5.87 

-0.05 

6.13 

458.74 

0.96 

10 

57 

19157.10 

336.09 

4.04 

5.82 

-0.07 

6.15 

468.89 

0.96 

11 

70 

21932.90 

313.33 

4.25 

5.75 

-0.08 

6.18 

482.85 

0.95 

12 

85 

25064.80 

294.88 

4.44 

5.69 

-0.09 

6.21 

498.48 

0.94 

13 

97 

27697.50 

285.54 

4.57 

5.65 

-0.10 

6.24 

512.14 

0.93 

14 

112 

30988.80 

276.69 

4.72 

5.62 

-0.11 

6.26 

524.41 

0.92 

15 

124 

34267.90 

276.35 

4.82 

5.62 

-0.12 

6.28 

532.87 

0.92 

16 

134 

37229.50 

277.83 

4.90 

5.63 

-0.12 

6.29 

538.15 

0.92 

17 

145 

40316.40 

278.04 

4.98 

5.63 

-0.13 

6.29 

541.51 

0.92 

18 

157 

43347.60 

276.10 

5.06 

5.62 

-0.13 

6.30 

544.01 

0.91 

19 

171 

46030.80 

269.19 

5.14 

5.60 

-0.13 

6.30 

547.18 

0.91 

20 

180 

47167.40 

262.04 

5.19 

5.57 

-0.13 

6.31 

551.19 

0.91 

KC-135R  (Stratotanker)  Learning  Cnrve  Calcnlations  In  BY  1981  Dollars  In  Millions 


Cnm 

Units 

Prodnced 

Cnm 

PROC 

Cost 

CAUC 

Ln  Cnm 

Units 

Prodnced 

Ln 

(CUAC) 

1 

98.00 

98.00 

0.00 

4.58 

10 

287.40 

28.74 

2.30 

3.36 

29 

605.60 

20.88 

3.37 

3.04 

59 

1004.50 

17.03 

4.08 

2.83 

102 

1473.20 

14.44 

4.62 

2.67 

148 

1911.50 

12.92 

5.00 

2.56 

198 

2414.50 

12.19 

5.29 

2.50 

248 

2864.20 

11.55 

5.51 

2.45 

297 

3319.10 

11.18 

5.69 

2.41 

329 

3687.90 

11.21 

5.80 

2.42 

360 

4034.50 

11.21 

5.89 

2.42 

386 

4346.00 

11.26 

5.96 

2.42 

405 

4581.60 

11.31 

6.00 

2.43 

406 

4596.30 

11.32 

6.01 

2.43 

Slope  (b) 


y-intercept 

(Ina) 


#NUM! 

4.58 

4.55 

4.52 

4.49 

4.46 

4.44 

4.42 

4.40 

4.38 

4.36 

4.35 

4.33 

4.32 


T1 


#NUM! 

98.00 

94.71 

91.47 
88.77 
86.73 

84.72 
83.03 

81.48 
80.00 
78.62 
77.34 
76.20 
75.31 


LCS 


#NUM! 

0.69 

0.72 

0.74 

0.75 

0.76 

0.77 

0.77 

0.77 

0.78 

0.78 

0.79 

0.79 

0.79 
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AV-8B  (Harrier)  Learning 


Cnm 
Lot  Units 
Nnmber  Prodnced 


Cnm 

PROC 

Cost 


1398.60 

1773.40 
2243.10 
2604.90 

2905.60 

3186.40 

3438.40 
3679.80 
3813.00 


CAUC 


39.28 
28.85 
23.31 

19.28 
16.25 

14.47 
14.24 
13.98 
13.64 

13.48 

13.67 


Cnrve  Calcnlations  In  BY  1979 


Ln  Cnm 
Units  Ln 

Prodnced  (CUAC)  Slope  (b) 


3.67 
3.36 
3.15 
2.96 
2.79 

2.67 
2.66 
2.64 
2.61 

2.60 

2.61 


Dollars  In  Millions 


y-intercept 


UM! 

#NUM! 

#NUM! 

.43 

83.82 

0.81 

.48 

87.86 

0.80 

.54 

93.94 

0.79 

.59 

98.80 

0.78 

.63 

102.34 

0.77 

.63 

102.30 

0.77 

.62 

101.20 

0.77 

.60 

99.97 

0.78 

.59 

98.51 

0.78 

.57 

96.85 

0.78 

AV-8B  (Harrier  Remannfactnre)  Learning  Cnrve  Calcnlations  In  BY  1994  Dollars  In  Millions 


Cnm  Cnm 
Lot  Units  PROC 
Nnmber  Prodnced  Cost 


CAUC 

Ln  Cnm 

Units 

Prodnced 

Ln 

(CUAC) 

Slope  (b) 

y-intercept 

(Ina) 

T1 

LCS 

35.25 

1.39 

3.56 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

33.16 

2.08 

3.50 

-0.09 

3.68 

39.83 

0.94 

31.61 

2.77 

3.45 

-0.08 

3.67 

39.23 

0.95 

30.09 

3.33 

3.40 

-0.08 

3.67 

39.33 

0.95 

28.55 

3.69 

3.35 

-0.09 

3.69 

39.91 

0.94 

28.71 

3.93 

3.36 

-0.08 

3.68 

39.64 

0.94 

28.08 

4.13 

3.34 

-0.08 

3.68 

39.59 

0.94 

26.91 

4.30 

3.29 

-0.09 

3.69 

39.94 

0.94 

F14-D  (Tomcat)  Learning  Cnrve  Calcnlations  In  BY  1989  Dollars  In  Millions 


Cnm 

Units 

Prodnced 

Cnm 

PROC 

Cost 

CAUC 

Ln  Cnm 

Units 

Prodnced 

7 

731.70 

104.53 

1.95 

19 

1632.10 

85.90 

2.94 

43 

3016.60 

70.15 

3.76 

55 

4268.00 

77.60 

4.01 

y-intercept 

(Ina) 


4.65 

5.03 

5.08 

4.97 


T1 


04.53 

53.23 

161.13 

143.84 
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1  r-16  (Fighting  Falcon)  Learning  Curve  Calculations  In  BY  1975  Dollars  In  Millions  | 

Cum 

Cum 

Ln  Cum 

Lot 

Units 

PROC 

Units 

Ln 

y-intercept 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Slope  (b) 

(Ina) 

T1 

LCS 

1 

105 

1071.70 

10.21 

4.65 

2.32 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

250 

1924.50 

7.70 

5.52 

2.04 

-0.33 

3.84 

46.36 

0.80 

425 

2796.50 

6.58 

6.05 

1.88 

-0.32 

3.79 

44.13 

0.80 

605 

3732.60 

6.17 

6.41 

1.82 

-0.29 

3.68 

39.50 

0.82 

5 

725 

4754.30 

6.56 

6.59 

1.88 

-0.25 

3.46 

31.85 

0.84 

6 

845 

5651.00 

6.69 

6.74 

1.90 

-0.22 

3.29 

26.77 

0.86 

7 

989 

6626.60 

6.70 

6.90 

1.90 

-0.19 

3.15 

23.30 

0.87 

8 

1139 

7695.50 

6.76 

7.04 

1.91 

-0.17 

3.03 

20.66 

0.89 

9 

1319 

8826.10 

6.69 

7.18 

1.90 

-0.15 

2.93 

18.80 

0.90 

10 

1499 

9914.80 

6.61 

7.31 

1.89 

-0.14 

2.86 

17.50 

0.91 

11 

1679 

10879.60 

6.48 

7.43 

1.87 

-0.13 

2.81 

16.69 

0.91 

12 

1859 

11983.30 

6.45 

7.53 

1.86 

-0.13 

2.77 

16.03 

0.92 

13 

2009 

13033.00 

6.49 

7.61 

1.87 

-0.12 

2.74 

15.41 

0.92 

14 

2117 

13696.00 

6.47 

7.66 

1.87 

-0.12 

2.70 

14.93 

0.92 

15 

2165 

14070.30 

6.50 

7.68 

1.87 

-0.11 

2.68 

14.53 

0.93 

16 

2189 

14286.30 

6.53 

7.69 

1.88 

-0.11 

2.65 

14.20 

0.93 

17 

2201 

14568.50 

6.62 

7.70 

1.89 

-0.10 

2.63 

13.86 

0.93 

1  F-22  (Raptor)  Learning  Curve  Calculations  In  BY  1990  Dollars  In  Millions  | 

Cum 

Cum 

Ln  Cum 

Lot 

Units 

PROC 

Units 

Ln 

y-intercept 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Slope  (b) 

(Ina) 

T1 

LCS 

711.10 

2924.80 
5273.50 

8795.80 

12252.90 
15735.30 

19126.90 
23205.60 

26919.90 

30217.70 

31277.70 


355.55 

243.73 

210.94 
183.25 
163.37 
147.06 
130.11 
114.31 

103.94 

95.93 

93.93 


#NUM! 

6.02 

6.02 

6.02 

6.02 

6.04 

6.06 

6.08 

6.11 

6.13 

6.15 


#NUM! 

0.86 

0.87 

0.87 

0.86 

0.86 

0.85 

0.85 

0.84 

0.84 

0.83 


95 


FA-18  E/F  (Super  Hornet)  Learning  Curve  Calculations  In  BY  2000  Dollars  In  Millions 


Cum 

Units 

Produced 

Cum 

PROC 

Cost 

CAUC 

Ln  Cum 

Units 

Produced 

Ln 

(CUAC) 

Slope  (b) 

y-intercept 

(Ina) 

T1 

LCS 

12 

2378.70 

198.23 

2.48 

5.29 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

32 

4555.80 

142.37 

3.47 

4.96 

-0.34 

6.13 

458.49 

#NUM! 

62 

7412.20 

119.55 

4.13 

4.78 

-0.31 

6.05 

425.16 

0.81 

98 

10236.50 

104.45 

4.58 

4.65 

-0.30 

6.03 

416.62 

0.81 

137 

13081.90 

95.49 

4.92 

4.56 

-0.30 

6.02 

409.81 

0.81 

185 

16166.50 

87.39 

5.22 

4.47 

-0.30 

6.01 

406.58 

0.81 

229 

19113.30 

83.46 

5.43 

4.42 

-0.29 

5.99 

400.92 

0.82 

271 

21951.40 

81.00 

5.60 

4.39 

-0.29 

5.98 

393.93 

0.82 

314 

24630.40 

78.44 

5.75 

4.36 

-0.28 

5.96 

387.85 

0.82 

364 

27771.10 

76.29 

5.90 

4.33 

-0.28 

5.94 

381.61 

0.82 

419 

31200.30 

74.46 

6.04 

4.31 

-0.27 

5.93 

375.14 

0.83 

461 

33986.10 

73.72 

6.13 

4.30 

-0.27 

5.91 

368.55 

0.83 

503 

36716.50 

73.00 

6.22 

4.29 

-0.27 

5.89 

362.20 

0.83 

548 

39394.90 

71.89 

6.31 

4.28 

-0.26 

5.88 

356.58 

0.83 

Lot 

Number 

Cum 

Units 

Produced 

Cum 

PROC 

Cost 

CAUC 

Ln  Cum 

Units 

Produced 

Ln 

(CUAC) 

Slope  (b) 

y-intercept 

(Ina) 

T1 

LCS 

1 

9 

368.70 

40.97 

2.20 

3.71 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

34 

971.00 

28.56 

3.53 

3.35 

-0.27 

4.31 

74.38 

0.83 

94 

1903.60 

20.25 

4.54 

3.01 

-0.30 

4.38 

79.87 

0.81 

157 

2931.30 

18.67 

5.06 

2.93 

-0.28 

4.34 

76.57 

0.82 

5 

241 

3947.10 

16.38 

5.48 

2.80 

-0.28 

4.33 

75.85 

0.82 

6 

325 

4849.40 

14.92 

5.78 

2.70 

-0.28 

4.33 

75.87 

0.82 

7 

409 

5732.90 

14.02 

6.01 

2.64 

-0.28 

4.33 

75.81 

0.82 

8 

493 

6500.50 

13.19 

6.20 

2.58 

-0.28 

4.33 

76.02 

0.82 

9 

577 

7292.40 

12.64 

6.36 

2.54 

-0.28 

4.33 

76.10 

0.82 

10 

661 

8105.60 

12.26 

6.49 

2.51 

-0.28 

4.33 

75.98 

0.82 

11 

745 

8901.60 

11.95 

6.61 

2.48 

-0.28 

4.33 

75.74 

0.82 

12 

811 

9517.80 

11.74 

6.70 

2.46 

-0.28 

4.32 

75.44 

0.82 

13 

859 

10059.00 

11.71 

6.76 

2.46 

-0.28 

4.32 

74.99 

0.82 

14 

907 

10676.00 

11.77 

6.81 

2.47 

-0.28 

4.31 

74.32 

0.83 

15 

943 

11056.20 

11.72 

6.85 

2.46 

-0.27 

4.30 

73.69 

0.83 

16 

979 

11519.70 

11.77 

6.89 

2.47 

-0.27 

4.29 

73.00 

0.83 

17 

1003 

11809.60 

11.77 

6.91 

2.47 

-0.27 

4.28 

72.36 

0.83 

18 

1015 

11984.40 

11.81 

6.92 

2.47 

-0.27 

4.27 

71.76 

0.83 
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T6-A  (JPATS)  Learning  Cnrve  Calcnlations  In  BY  2002  Dollars  In  Millions 
Cnm  Cnm  Ln  Cnm 

Lot  Units  PROC  Units  Ln  y-intercept 

Nnmber  Prodnced  Cost  CAUC  Prodnced  (CUAC)  Slope  (b)  (Ina)  T1  LCS 

1  3  86.00  28.67  1.10  3.36  #NUM!  #NUM!  #NUM!  #NUM! 

2  9  101.70  11.30  2.20  2.42  -0.85  4.29  72.72  0.56 

3  24  164.80  6.87  3.18  1.93  -0.69  4.06  57.92  0.62 

4  46  239.50  5.21  3.83  1.65  -0.62  3.94  51.42  0.65 

5  68  350.10  5.15  4.22  1.64  -0.56  3.81  45.29  0.68 

6  109  514.20  4.72  4.69  1.55  -0.50  3.69  40.02  0.71 

7  167  728.00  4.36  5.12  1.47  -0.45  3.58  35.88  0.73 

8  213  969.00  4.55  5.36  1.51  -0.41  3.48  32.44  0.75 

9  248  1211.80  4.89  5.51  1.59  -0.38  3.39  29.62  0.77 

10  300  1509.30  5.03  5.70  1.62  -0.35  3.30  27.24  0.78 

11  353  1811.30  5.13  5.87  1.64  -0.32  3.23  25.27  0.80 

12  407  2127.40  5.23  6.01  1.65  -0.30  3.16  23.63  0.81 

13  481  2553.00  5.31  6.18  1.67  -0.28  3.10  22.17  0.82 

14  544  2902.00  5.33  6.30  1.67  -0.26  3.04  20.95  0.83 

15  592  3160.20  5.34  6.38  1.67  -0.25  2.99  19.97  0.84 

16  640  3447.30  5.39  6.46  1.68  -0.24  2.95  19.15  0.85 

17  688  3704.00  5.38  6.53  1.68  -0.23  2.92  18.45  0.85 

18  736  3961.40  5.38  6.60  1.68  -0.22  2.88  17.86  0.86 

19  782  4244.70  5.43  6.66  1.69  -0.21  2.85  17.33  0.87 


T-45-TS  (Goshawk)  Learning  Cnrve  Calcnlations  In  BY  1995  Dollars  In  Millions 


Lot 

Nnmber 

Cnm 

Units 

Prodnced 

Cnm 

PROC 

Cost 

CAUC 

Ln  Cnm 

Units 

Prodnced 

Ln 

(CUAC) 

Slope  (b) 

y-intercept 

(Ina) 

T1 

LCS 

1 

12 

560.10 

46.68 

2.48 

3.84 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

36 

978.70 

27.19 

3.58 

3.30 

-0.49 

5.07 

158.50 

0.71 

48 

1642.60 

34.22 

3.87 

3.53 

-0.30 

4.55 

94.42 

0.81 

60 

1924.30 

32.07 

4.09 

3.47 

-0.24 

4.39 

80.88 

0.84 

5 

72 

2240.50 

31.12 

4.28 

3.44 

-0.22 

4.31 

74.52 

0.86 

6 

84 

2497.70 

29.73 

4.43 

3.39 

-0.21 

4.28 

72.03 

0.87 

7 

96 

2804.30 

29.21 

4.56 

3.37 

-0.20 

4.25 

70.09 

0.87 

8 

108 

3088.60 

28.60 

4.68 

3.35 

-0.19 

4.23 

68.79 

0.88 

9 

123 

3366.40 

27.37 

4.81 

3.31 

-0.19 

4.23 

68.68 

0.88 

10 

138 

3655.40 

26.49 

4.93 

3.28 

-0.19 

4.23 

69.02 

0.87 

11 

153 

3964.20 

25.91 

5.03 

3.25 

-0.19 

4.24 

69.34 

0.87 

12 

167 

4242.60 

25.40 

5.12 

3.23 

-0.20 

4.24 

69.66 

0.87 

13 

173 

4412.30 

25.50 

5.15 

3.24 

-0.20 

4.24 

69.58 

0.87 

14 

181 

4615.70 

25.50 

5.20 

3.24 

-0.19 

4.24 

69.28 

0.87 
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